-- Logs begin at Fri 2022-06-24 07:20:53 UTC, end at Fri 2022-06-24 08:39:14 UTC. -- Jun 24 07:57:38.459485 dv-cinder-834822-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 07:57:38.468362 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 07:57:38 2022] *** Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: nodename: dv-cinder-834822-6-iscsi Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: machine: x86_64 Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: clock source: unix Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: pcre jit disabled Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: detected number of CPU cores: 4 Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: current working directory: / Jun 24 07:57:38.470366 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: detected binary path: /usr/bin/uwsgi-core Jun 24 07:57:38.470926 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: your processes number limit is 47680 Jun 24 07:57:38.470926 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: your memory page size is 4096 bytes Jun 24 07:57:38.470926 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: detected max file descriptor number: 2048 Jun 24 07:57:38.470926 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: lock engine: pthread robust mutexes Jun 24 07:57:38.470926 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: thunder lock: enabled Jun 24 07:57:38.470926 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 07:57:38.470926 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 07:57:38.515570 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: Python main interpreter initialized at 0x561bdda0a9c0 Jun 24 07:57:38.515570 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: python threads support enabled Jun 24 07:57:38.515570 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: your server socket listen backlog is limited to 100 connections Jun 24 07:57:38.515570 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: your mercy for graceful operations on workers is 90 seconds Jun 24 07:57:38.515905 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 07:57:38.515979 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: *** Operational MODE: preforking *** Jun 24 07:57:38.516276 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: *** uWSGI is running in multiple interpreter mode *** Jun 24 07:57:38.516276 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: spawned uWSGI master process (pid: 80443) Jun 24 07:57:38.516472 dv-cinder-834822-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 24 07:57:38.517298 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: spawned uWSGI worker 1 (pid: 80451, cores: 1) Jun 24 07:57:38.517387 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: spawned uWSGI worker 2 (pid: 80452, cores: 1) Jun 24 07:57:38.520235 dv-cinder-834822-6-iscsi devstack@keystone.service[80443]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 07:57:44.002462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 07:57:44.002462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jun 24 07:57:44.003226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 07:57:44.003226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jun 24 07:57:44.004447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 07:57:44.004447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: from cryptography.utils import int_from_bytes Jun 24 07:57:44.004894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 07:57:44.004894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: from cryptography.utils import int_from_bytes Jun 24 07:57:44.051963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 07:57:44.052161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 07:57:44.052374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] command line args: [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 07:57:44.052646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 07:57:44.052776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 07:57:44.052862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ================================================================================ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 07:57:44.053063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 07:57:44.053151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.053262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] command line args: [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 07:57:44.053371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] config_dir = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.053459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.053534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 07:57:44.053645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] config_source = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.053738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ================================================================================ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 07:57:44.053832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] debug = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.053950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] admin_token = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] config_dir = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] config_source = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] debug = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.054899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] log_config_append = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] log_dir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.055968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] log_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] log_config_append = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056510 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] log_dir = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] log_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.056980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.057918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.058881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.059904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] publish_errors = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.060795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] publish_errors = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] standard_threads = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.061963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] use_journal = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] standard_threads = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] use_json = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] use_stderr = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] use_syslog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.062966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.063177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.063344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] use_journal = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.063459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.063577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] use_json = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.063577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] use_stderr = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.063873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.064317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] use_syslog = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.064457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.064573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 07:57:44.064684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.064809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.064923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065643 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.065881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.066936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.067980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.068958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.069941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.070974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.071890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072377 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.072957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073153 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.073972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.074880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.075918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.076969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077083 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.077893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078705 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.078931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.079947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.080059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.080183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.080342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.080456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.080568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.080680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.081282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.081588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.081705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.081931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.082982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.083210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.083323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.083435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.083548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.083662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.083783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.083898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.084975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.085894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.086945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.087979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088705 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.088940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.089775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.external = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.089897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.external = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.password = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.090982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.token = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.password = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.token = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.091909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.092886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093705 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.093941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.094987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.095107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.095231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.095354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.095468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.095582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.095695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.095827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.096019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.096146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.096286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.096401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.097876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098100 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.098788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.099923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.100901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.101939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.102985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.103911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.104968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.105883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.106226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.106346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.106459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.106581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.106697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.106814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.106929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.107965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.108935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109275 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.109973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.110909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.111939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.112958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.113990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.114906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.115945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.116890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.117931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.118959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.119950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.120925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.121967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122194 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.122984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123209 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] role.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] role.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.123904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] role.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] role.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124851 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.124963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.125988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.126914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.127027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.127140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.127252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.127373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.127487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.127601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.127738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.128277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.128400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.128530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.128647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.128763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.128877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.128990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.129922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.130967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.131968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132461 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.132938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.133971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.134894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.135933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.136907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.137839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.138949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.139978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 07:57:44.140845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 07:57:44.140845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 07:57:44.168948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.169176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.169407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.170119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.170354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.170583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.177967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.179393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.206315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.206602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.214751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.214987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.353531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.354412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.410618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.410878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.423440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.423814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.488158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.488433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.488610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.488826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.489038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.489250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.489687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.489921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.490143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.490445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.490611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.490770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.519522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.519803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.519958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.520181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.520699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.520699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.520935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.521117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.521354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.521578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.521796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.522010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.522221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.522432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.532132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.535587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.545624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.545836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.546059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.546257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.546491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.546737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.546950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.547618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.547853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.548078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.548331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.548550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.548766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.548981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 07:57:44.564690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.564916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 07:57:44.565278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.565611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 07:57:44.565938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.566033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.566203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.566293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 07:57:44.566463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.566552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.566721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 07:57:44.566808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.566995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.567262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.567515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.567770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.577635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.577917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.578185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.578465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.582429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.582429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.582429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.582429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.587385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.590691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.590967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.591246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.591523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.591649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.591801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.592063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.592351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.592626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.592934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.593208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.593476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.594864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.595141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.595419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.595878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.596388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.597178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.597454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.597731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.598001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.598444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.598760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.621912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.623586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.623865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.629213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.629607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.629889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.630121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.632256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.632624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.637249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.637530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.638454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.638860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.639297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.642663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.642950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.643233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.643605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.644138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.644443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.644720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.644989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.647566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.647994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.652964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.653251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.653536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.653818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.654100 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.654372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.654810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.655290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.664589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.664874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.669524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.673216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.673615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.678246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.678529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.679271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.682907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.685251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.686643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.686943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.687226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.687510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.687793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.688071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.688904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.689308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.695103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.699360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.703165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.703675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.704177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.704612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.704902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.705184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.707463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.707742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.708007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.708303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.716444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.718209 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.718479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.722431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.722711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.722990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.723305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.723815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.727881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.728404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.728867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.729225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.737812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.738204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.738550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.738833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.739595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.740566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.740859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.741155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.741923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.742196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.745420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.745707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.745988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.746416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.746892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.759080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.760183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.760488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.760936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.761232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.762395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.762932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.763226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.763524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.765716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.767489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.769949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.770223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.770500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.777850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.779460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.782693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.782999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.783395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.783675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.787523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.791060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.793690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.793978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.794257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.795885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.798298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.800904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.801350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.801800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.802282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.802559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.802835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.803106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.803372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.803759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.804041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.804347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.804618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.804931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.805166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.805436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.805707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.805971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.812690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.814308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.818145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.818438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.818830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.819111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.830156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.830445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.830733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.840314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 07:57:44.840764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.841207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.841493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.841768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.842326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.842620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.842906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.843180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.843458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.843730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.843994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.844283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.844562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 07:57:44.844737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561bdda0a9c0 pid: 80451 (default app) Jun 24 07:57:44.848435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d170c-44f9-4bb4-ace1-c63870c66782 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:44.848729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d170c-44f9-4bb4-ace1-c63870c66782 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:44.849006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d170c-44f9-4bb4-ace1-c63870c66782 None None] PATH_INFO: `/v3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:44.853739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri Jun 24 07:57:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:57:44.890496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561bdda0a9c0 pid: 80452 (default app) Jun 24 07:57:53.810907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3f1a-5f8c-4f3f-9c93-a184a4cb962a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:53.811481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3f1a-5f8c-4f3f-9c93-a184a4cb962a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:53.811481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3f1a-5f8c-4f3f-9c93-a184a4cb962a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:53.812846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:57:53.821388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:53.821820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:53.821949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:53.891870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: INFO dbcounter [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] Registered counter for database keystone Jun 24 07:57:53.913056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG oslo_db.sqlalchemy.engines [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 07:57:53.919239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writer thread running {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 07:57:54.095980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80452) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 07:57:54.097078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80452) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 07:57:54.151777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:57:54.153340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:57:54.274594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:57:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 24 07:57:54.439137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3f1a-5f8c-4f3f-9c93-a184a4cb962a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:54.509792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: INFO dbcounter [None req-8e8d3f1a-5f8c-4f3f-9c93-a184a4cb962a None None] Registered counter for database keystone Jun 24 07:57:54.530007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8d3f1a-5f8c-4f3f-9c93-a184a4cb962a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 07:57:54.536907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writer thread running {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 07:57:54.655117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3f1a-5f8c-4f3f-9c93-a184a4cb962a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:54.659897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9257ce-22d5-4792-bc7f-da2f09d0065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:54.660571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9257ce-22d5-4792-bc7f-da2f09d0065a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:54.660849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9257ce-22d5-4792-bc7f-da2f09d0065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:54.661119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9257ce-22d5-4792-bc7f-da2f09d0065a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:54.669077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9257ce-22d5-4792-bc7f-da2f09d0065a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:54.720958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a9257ce-22d5-4792-bc7f-da2f09d0065a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 07:57:54.721237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9257ce-22d5-4792-bc7f-da2f09d0065a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:54.731302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Jun 24 07:57:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 07:57:54.737280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:54.751527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cfdf3-e1c7-4495-bd25-1e72ccd85f55 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:54.756001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf95cd-b5fa-486e-b388-98cc026615bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:54.757142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf95cd-b5fa-486e-b388-98cc026615bf admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:54.757433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf95cd-b5fa-486e-b388-98cc026615bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:54.757710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf95cd-b5fa-486e-b388-98cc026615bf admin admin] PATH_INFO: `/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:54.761779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf95cd-b5fa-486e-b388-98cc026615bf admin admin] RBAC: Authorizing `identity:get_project(project_id=7ed29b44386f4c7ba3757cfe7b05f1c4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:54.813327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0bdf95cd-b5fa-486e-b388-98cc026615bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 07:57:54.813667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf95cd-b5fa-486e-b388-98cc026615bf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:54.818312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 2/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri Jun 24 07:57:54 2022] GET /identity/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:57:56.817122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5ad3-896a-47d3-9f64-0d672ec602b6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:56.817630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5ad3-896a-47d3-9f64-0d672ec602b6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:56.817734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5ad3-896a-47d3-9f64-0d672ec602b6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:56.821853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 4/6] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:57:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:57:56.827092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5718-1be4-4dc2-be14-3a9e58106799 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:56.827520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5718-1be4-4dc2-be14-3a9e58106799 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:56.827653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5718-1be4-4dc2-be14-3a9e58106799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:56.847654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-71cd5718-1be4-4dc2-be14-3a9e58106799 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:57:56.849146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-71cd5718-1be4-4dc2-be14-3a9e58106799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:57:56.857020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:57:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 07:57:56.879186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5ad3-896a-47d3-9f64-0d672ec602b6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:56.891266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5ad3-896a-47d3-9f64-0d672ec602b6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:56.896474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b5612-ab84-406f-a4b9-d6f050648b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:56.897102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5612-ab84-406f-a4b9-d6f050648b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:56.897389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5612-ab84-406f-a4b9-d6f050648b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:56.897669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5612-ab84-406f-a4b9-d6f050648b87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:56.905368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b5612-ab84-406f-a4b9-d6f050648b87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:56.907142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b5612-ab84-406f-a4b9-d6f050648b87 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:56.917980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Jun 24 07:57:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:57:56.923466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd5718-1be4-4dc2-be14-3a9e58106799 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:56.932653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd5718-1be4-4dc2-be14-3a9e58106799 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:56.937030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324649a-8fee-4176-b5b0-8c9fb48ddb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:56.937877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324649a-8fee-4176-b5b0-8c9fb48ddb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:56.938159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324649a-8fee-4176-b5b0-8c9fb48ddb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:56.938434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324649a-8fee-4176-b5b0-8c9fb48ddb36 admin admin] PATH_INFO: `/v3/users/173c08a245ff42c4826381dd87480484` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:56.939815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324649a-8fee-4176-b5b0-8c9fb48ddb36 admin admin] RBAC: Authorizing `identity:get_user(user_id=173c08a245ff42c4826381dd87480484)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:56.941684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324649a-8fee-4176-b5b0-8c9fb48ddb36 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:56.943253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 4/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri Jun 24 07:57:56 2022] GET /identity/v3/users/173c08a245ff42c4826381dd87480484 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:57:59.029226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc481c6-43fa-470c-b87a-69a326d1a8b7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.029771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc481c6-43fa-470c-b87a-69a326d1a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.029771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc481c6-43fa-470c-b87a-69a326d1a8b7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.031202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:57:59.037242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d305d-d394-4877-9479-c706e8dabc6d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.037675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d305d-d394-4877-9479-c706e8dabc6d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.037815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d305d-d394-4877-9479-c706e8dabc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.053246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad13e2-12ff-41fe-ad74-fa402600647e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.053531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad13e2-12ff-41fe-ad74-fa402600647e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.053803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad13e2-12ff-41fe-ad74-fa402600647e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.054386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e38d305d-d394-4877-9479-c706e8dabc6d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:57:59.055272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 7/11] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:57:59.055625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e38d305d-d394-4877-9479-c706e8dabc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:57:59.060046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.060360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.060640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.101843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG passlib.handlers.bcrypt [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80451) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 07:57:59.102259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG passlib.handlers.bcrypt [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80451) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 07:57:59.137140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 5/12] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:57:59.149430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:57:59.150993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:57:59.160079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d305d-d394-4877-9479-c706e8dabc6d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.183034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:57:59.252686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:57:59.263201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d305d-d394-4877-9479-c706e8dabc6d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:59.276373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.298096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:59.298675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.298956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.299232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.366257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:59.367741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:59.375757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24fbd-1285-4fef-b796-b59f1ec69b1e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:59.378720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:57:59.391227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:57:59.412976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:59.414014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.414308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.414588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.427168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:57:59.438527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:57:59.439442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:57:59.441433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 9/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:57:59.446301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.467895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 6/15] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:57:59.473709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.545568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548c89b-e8f2-4ada-a4ab-761dc6595b35 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:59.571687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780e1bd-4f66-4660-97a0-cef7afb14a9f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:59.579412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:59.580072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.580387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.581219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.581954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:57:59.582258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:59.583687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:59.594645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:57:59.595640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 10/16] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:57:59.601633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.608247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:59.608247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.608247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.608247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.619379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:59.620909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:59.629496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:57:59.641419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:57:59.644230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:57:59.645069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:57:59.645069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:57:59.645069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:57:59.645069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:57:59.645069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 7/17] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:57:59.648703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.701925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba0f05-1c32-4161-9de7-249443aa52b4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:59.734956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:59.735821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.736105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.736488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] PATH_INFO: `/v3/users/173c08a245ff42c4826381dd87480484` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.738771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] RBAC: Authorizing `identity:get_user(user_id=173c08a245ff42c4826381dd87480484)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:59.740239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:59.742074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 11/18] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/users/173c08a245ff42c4826381dd87480484 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:57:59.747232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.749151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b457b4d-44cf-4f32-b30b-575b6c58a346 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:59.783295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:59.783999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.784305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.784579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.785293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:57:59.785601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:59.786979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:59.805178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 8/19] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:57:59.848730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:57:59.855917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fb9e0-5c19-451c-8bef-d5596d971626 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:57:59.892086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bc5d6-b57a-470c-a05d-8ae3d193d61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:57:59.892925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bc5d6-b57a-470c-a05d-8ae3d193d61a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:57:59.893794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bc5d6-b57a-470c-a05d-8ae3d193d61a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:57:59.894347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bc5d6-b57a-470c-a05d-8ae3d193d61a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:57:59.895602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bc5d6-b57a-470c-a05d-8ae3d193d61a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:57:59.897170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bc5d6-b57a-470c-a05d-8ae3d193d61a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:57:59.899017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 12/20] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:57:59.904953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:57:59.941754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:00.009383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1176f-30de-45db-80d6-2b2e344c436a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:00.045965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f2661-d2cd-43b7-a8c5-45c2c23e3234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:00.047289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2661-d2cd-43b7-a8c5-45c2c23e3234 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:00.047576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2661-d2cd-43b7-a8c5-45c2c23e3234 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:00.047853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2661-d2cd-43b7-a8c5-45c2c23e3234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:00.048748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2661-d2cd-43b7-a8c5-45c2c23e3234 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.domain.id=default, user.id=173c08a245ff42c4826381dd87480484) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:00.049061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2661-d2cd-43b7-a8c5-45c2c23e3234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:00.051345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2661-d2cd-43b7-a8c5-45c2c23e3234 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:00.058447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 9/21] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Jun 24 07:57:59 2022] GET /identity/v3/role_assignments?user.id=173c08a245ff42c4826381dd87480484&scope.domain.id=default&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:02.205102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068333-7394-4dd3-b6ef-2297da7529ae None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.206726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068333-7394-4dd3-b6ef-2297da7529ae None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.207280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068333-7394-4dd3-b6ef-2297da7529ae None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.208941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 13/22] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:02.214311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb04ba8-a015-481b-897e-ff0f322d391b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.215163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb04ba8-a015-481b-897e-ff0f322d391b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.215647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb04ba8-a015-481b-897e-ff0f322d391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.237964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4bb04ba8-a015-481b-897e-ff0f322d391b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:02.239475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4bb04ba8-a015-481b-897e-ff0f322d391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:02.321134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 10/23] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:02.353724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e068333-7394-4dd3-b6ef-2297da7529ae None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:02.479137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e068333-7394-4dd3-b6ef-2297da7529ae None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:02.516288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:02.517495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.517981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.519287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.539340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:02.541855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986ca11-96a4-49ed-b884-4a5bf570d889 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.542353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986ca11-96a4-49ed-b884-4a5bf570d889 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.542851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986ca11-96a4-49ed-b884-4a5bf570d889 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.544463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 11/24] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:02.545893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:02.550889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aa80d-5f2d-443d-aa65-9700c7afdc5f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.551431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aa80d-5f2d-443d-aa65-9700c7afdc5f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.551931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aa80d-5f2d-443d-aa65-9700c7afdc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.582063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b91aa80d-5f2d-443d-aa65-9700c7afdc5f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:58:02.583057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:02.583860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:02.584692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:58:02.584692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:58:02.584692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:58:02.584692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:02.585872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b91aa80d-5f2d-443d-aa65-9700c7afdc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:02.592405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 14/25] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:02.598253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:02.643025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:02.643785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:02.673020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:02.674667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596629f-54e0-441a-a251-64c44590cc26 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.675712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596629f-54e0-441a-a251-64c44590cc26 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.676146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596629f-54e0-441a-a251-64c44590cc26 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.677602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:02.682297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073c77f-f40b-4b01-86fb-9d070ca5cac7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.682297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073c77f-f40b-4b01-86fb-9d070ca5cac7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.684186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073c77f-f40b-4b01-86fb-9d070ca5cac7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.690980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 14/28] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:02.690980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846162e-fb32-44bd-a6d1-295538c31bf8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.690980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846162e-fb32-44bd-a6d1-295538c31bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.690980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846162e-fb32-44bd-a6d1-295538c31bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.710668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7846162e-fb32-44bd-a6d1-295538c31bf8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:02.712122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7846162e-fb32-44bd-a6d1-295538c31bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:02.752277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa798bc-22c1-4ffc-94a9-a639837b3add None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:02.791191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:02.791854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.792140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.792389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:02.792581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.793279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:02.793592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:02.793690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88525-48e0-4b5a-bd38-ec9e7f1da1d8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:02.793946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88525-48e0-4b5a-bd38-ec9e7f1da1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:02.794246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88525-48e0-4b5a-bd38-ec9e7f1da1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:02.795101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:02.814766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 15/30] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:02.816597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:02.819584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3ea88525-48e0-4b5a-bd38-ec9e7f1da1d8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:02.820931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3ea88525-48e0-4b5a-bd38-ec9e7f1da1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:02.913867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:02.919570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 16/31] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:02.920932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea88525-48e0-4b5a-bd38-ec9e7f1da1d8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:02.944566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:02.972697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84404de5-5dc4-465e-b7fb-3f53ca497efc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:03.018912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:03.019852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.020139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.020892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.021663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:03.023500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:03.032549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea88525-48e0-4b5a-bd38-ec9e7f1da1d8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:03.069696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:03.070487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.070770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.071048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.083074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:03.091913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:03.092996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 17/32] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:03.094104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:03.182363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:03.204784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91713276-79ee-4d10-902c-a50ba1156494 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:03.241968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:03.242743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.243095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.243445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.244258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:03.245787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:03.272667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 16/33] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 07:58:02 2022] POST /identity/v3/roles => generated 225 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:03.273748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:03.439644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8bfbb-ab3d-471b-9017-71a49b1a2526 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:03.493001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:03.493675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.493959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.494237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.494996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:03.496531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:03.498996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:03.517995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 18/34] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:58:03 2022] POST /identity/v3/projects => generated 301 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:03.519877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:03.590147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 17/35] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 07:58:03 2022] POST /identity/v3/roles => generated 219 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:03.663337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d56f-152b-495a-ae53-7e265030cb30 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:03.702207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:03.711820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d777de-e396-46db-be7d-873dcbf79050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:03.712548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d777de-e396-46db-be7d-873dcbf79050 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.712844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d777de-e396-46db-be7d-873dcbf79050 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.713128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d777de-e396-46db-be7d-873dcbf79050 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.714048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d777de-e396-46db-be7d-873dcbf79050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:03.714308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d777de-e396-46db-be7d-873dcbf79050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:03.715929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d777de-e396-46db-be7d-873dcbf79050 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:03.731445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 19/36] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:03.738186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:03.770966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe2ef-ab1d-4b32-8ef2-2f1ff7701c03 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.771284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe2ef-ab1d-4b32-8ef2-2f1ff7701c03 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.771528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe2ef-ab1d-4b32-8ef2-2f1ff7701c03 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.773149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 20/37] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:03.779116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28627a-bb9e-4be7-9b98-e5483fcaa9ec None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.779658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28627a-bb9e-4be7-9b98-e5483fcaa9ec None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.779946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28627a-bb9e-4be7-9b98-e5483fcaa9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.814445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0b28627a-bb9e-4be7-9b98-e5483fcaa9ec None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:03.817619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0b28627a-bb9e-4be7-9b98-e5483fcaa9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:03.895239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b765-27d1-42d3-a074-fc963d62b9ff None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:03.911183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 21/38] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:03.935009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28627a-bb9e-4be7-9b98-e5483fcaa9ec None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:03.940489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:03.941706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:03.942202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:03.942741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] PATH_INFO: `/v3/users/173c08a245ff42c4826381dd87480484` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:03.944231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] RBAC: Authorizing `identity:get_user(user_id=173c08a245ff42c4826381dd87480484)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:03.945909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:03.947863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 18/39] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:03 2022] GET /identity/v3/users/173c08a245ff42c4826381dd87480484 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:03.953233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:04.030480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:04.073573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc93ca-42de-49de-83f6-cdf3beba3f59 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:04.114890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb06fc-ba52-43fe-9cd1-8e79d6034688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:04.115687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb06fc-ba52-43fe-9cd1-8e79d6034688 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:04.115976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb06fc-ba52-43fe-9cd1-8e79d6034688 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:04.116294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb06fc-ba52-43fe-9cd1-8e79d6034688 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:04.117578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb06fc-ba52-43fe-9cd1-8e79d6034688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:04.119031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb06fc-ba52-43fe-9cd1-8e79d6034688 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:04.120702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 19/40] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:04.122028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd70cb-0fec-4325-bccc-9ccf0a9330ff None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:04.122610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd70cb-0fec-4325-bccc-9ccf0a9330ff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:04.122610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd70cb-0fec-4325-bccc-9ccf0a9330ff None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:04.123836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 20/41] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:04.126177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd70cb-0fec-4325-bccc-9ccf0a9330ff None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:04.162990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28627a-bb9e-4be7-9b98-e5483fcaa9ec None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:04.185119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:04.196323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31c241-f6c3-4e82-91da-6ad2d4085d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:04.196983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c241-f6c3-4e82-91da-6ad2d4085d88 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:04.198487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c241-f6c3-4e82-91da-6ad2d4085d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:04.198487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c241-f6c3-4e82-91da-6ad2d4085d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:04.198487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31c241-f6c3-4e82-91da-6ad2d4085d88 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:04.199677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31c241-f6c3-4e82-91da-6ad2d4085d88 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:04.227659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd70cb-0fec-4325-bccc-9ccf0a9330ff None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:04.255760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:04.261370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:04.262234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:04.262524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:04.262807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] PATH_INFO: `/v3/domains/default/users/173c08a245ff42c4826381dd87480484/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:04.264850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=173c08a245ff42c4826381dd87480484, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:04.266309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:04.325075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 07:58:03 2022] POST /identity/v3/roles => generated 223 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:58:04.326333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083082-3da9-4a72-99e4-24633b7815a9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:04.326622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083082-3da9-4a72-99e4-24633b7815a9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:04.326902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083082-3da9-4a72-99e4-24633b7815a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:04.345007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-46083082-3da9-4a72-99e4-24633b7815a9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:04.346886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-46083082-3da9-4a72-99e4-24633b7815a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:04.361149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 21/43] 10.222.0.42 () {58 vars in 1361 bytes} [Fri Jun 24 07:58:04 2022] PUT /identity/v3/domains/default/users/173c08a245ff42c4826381dd87480484/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:04.441176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:04.465503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:04.578781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493dbb3-b1a9-40f3-8d88-645da55d7ced None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:04.613595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb99a6-7689-496c-9fcc-cd93e0a6d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:04.614387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb99a6-7689-496c-9fcc-cd93e0a6d5ec None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:04.614672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb99a6-7689-496c-9fcc-cd93e0a6d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:04.614947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb99a6-7689-496c-9fcc-cd93e0a6d5ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:04.616114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb99a6-7689-496c-9fcc-cd93e0a6d5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:04.617604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb99a6-7689-496c-9fcc-cd93e0a6d5ec None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:04.619224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 22/45] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:04.624731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46083082-3da9-4a72-99e4-24633b7815a9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:04.723903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46083082-3da9-4a72-99e4-24633b7815a9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:04.737003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:04.758046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e19e9-b2a5-4c36-9e4c-f398279fe2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:04.758709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e19e9-b2a5-4c36-9e4c-f398279fe2a0 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:04.758992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e19e9-b2a5-4c36-9e4c-f398279fe2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:04.759273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e19e9-b2a5-4c36-9e4c-f398279fe2a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:04.759988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e19e9-b2a5-4c36-9e4c-f398279fe2a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:04.761488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e19e9-b2a5-4c36-9e4c-f398279fe2a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:04.881581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:58:04 2022] POST /identity/v3/projects => generated 312 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:58:06.411295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12f9ad-63d3-474a-96f1-0659b18f5dc3 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:06.411817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12f9ad-63d3-474a-96f1-0659b18f5dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:06.411817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12f9ad-63d3-474a-96f1-0659b18f5dc3 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:06.413255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:06.418382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bce06-8908-4cc9-bb8d-6610e7ca15cf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:06.418815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bce06-8908-4cc9-bb8d-6610e7ca15cf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:06.419007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bce06-8908-4cc9-bb8d-6610e7ca15cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:06.436362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d33bce06-8908-4cc9-bb8d-6610e7ca15cf None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:06.437553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d33bce06-8908-4cc9-bb8d-6610e7ca15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:06.504888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:06.528680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12f9ad-63d3-474a-96f1-0659b18f5dc3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:06.588113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:06.630049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12f9ad-63d3-474a-96f1-0659b18f5dc3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:06.663345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:06.664055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:06.664368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:06.664644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:06.674944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:06.682406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:06.683289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:06.684058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:06.689337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bce06-8908-4cc9-bb8d-6610e7ca15cf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:06.781222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:06.788175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bce06-8908-4cc9-bb8d-6610e7ca15cf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:06.822095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3841e-58d3-4bc6-9abd-e25da7e88af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:06.822758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3841e-58d3-4bc6-9abd-e25da7e88af0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:06.823040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3841e-58d3-4bc6-9abd-e25da7e88af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:06.823313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3841e-58d3-4bc6-9abd-e25da7e88af0 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:06.824063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3841e-58d3-4bc6-9abd-e25da7e88af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:06.824399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3841e-58d3-4bc6-9abd-e25da7e88af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:06.825777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3841e-58d3-4bc6-9abd-e25da7e88af0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:06.833891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:06.839465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:06.930330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252f91c-be22-48cc-b80e-6e986152dbeb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:06.930572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252f91c-be22-48cc-b80e-6e986152dbeb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:06.930863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252f91c-be22-48cc-b80e-6e986152dbeb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:06.932434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 27/51] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:06.937094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c2b9-8bbf-412d-9bdf-bded7739f609 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:06.937384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c2b9-8bbf-412d-9bdf-bded7739f609 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:06.937664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c2b9-8bbf-412d-9bdf-bded7739f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:06.940292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1bd72-36c9-4d99-bf89-c97c3d6a9e16 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:06.954423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7f23c2b9-8bbf-412d-9bdf-bded7739f609 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:06.955740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7f23c2b9-8bbf-412d-9bdf-bded7739f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:06.957370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:06.974595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:06.975490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:06.975773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:06.976058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] PATH_INFO: `/v3/users/173c08a245ff42c4826381dd87480484` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:06.977299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] RBAC: Authorizing `identity:get_user(user_id=173c08a245ff42c4826381dd87480484)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:06.978746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:06.980609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 25/52] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:06 2022] GET /identity/v3/users/173c08a245ff42c4826381dd87480484 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:06.986281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:07.023328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:07.046914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23c2b9-8bbf-412d-9bdf-bded7739f609 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:07.087557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057415d0-1314-4936-9a98-caf0d220a706 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:07.121852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:07.122647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:07.122990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:07.123273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:07.124493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:07.125940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:07.127577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 26/54] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:07.131157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:07.133731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:07.146110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23c2b9-8bbf-412d-9bdf-bded7739f609 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:07.182486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:07.183208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:07.183498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:07.183772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:07.184984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:07.186434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:07.188061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 29/55] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:07.189146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:07.193617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:07.234190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f401884-ba7e-40ff-913a-d21113516570 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:07.268821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0cff7-d772-40c0-9807-b4922ed00c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:07.269663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cff7-d772-40c0-9807-b4922ed00c30 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:07.269954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cff7-d772-40c0-9807-b4922ed00c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:07.270229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cff7-d772-40c0-9807-b4922ed00c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:07.271059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cff7-d772-40c0-9807-b4922ed00c30 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.domain.id=default, user.id=173c08a245ff42c4826381dd87480484) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:07.271369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cff7-d772-40c0-9807-b4922ed00c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:07.272834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cff7-d772-40c0-9807-b4922ed00c30 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:07.281061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 27/56] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Jun 24 07:58:07 2022] GET /identity/v3/role_assignments?user.id=173c08a245ff42c4826381dd87480484&scope.domain.id=default&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:07.290899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd740-db06-4651-8f41-151c19fe13d7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:07.328084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5f95c-940c-4ed1-94a0-9c2472262999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:07.328778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f95c-940c-4ed1-94a0-9c2472262999 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:07.329067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f95c-940c-4ed1-94a0-9c2472262999 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:07.329342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f95c-940c-4ed1-94a0-9c2472262999 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:07.330075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5f95c-940c-4ed1-94a0-9c2472262999 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:07.331689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5f95c-940c-4ed1-94a0-9c2472262999 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:07.497619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 30/57] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Jun 24 07:58:07 2022] POST /identity/v3/projects => generated 298 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:58:09.527395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6d7b-0961-47db-b381-8aee3061358f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:09.527910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6d7b-0961-47db-b381-8aee3061358f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:09.527993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6d7b-0961-47db-b381-8aee3061358f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:09.529358 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 28/58] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:09.535273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ffa33-7284-475d-bd49-398167b1351a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:09.535671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ffa33-7284-475d-bd49-398167b1351a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:09.535833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ffa33-7284-475d-bd49-398167b1351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:09.547244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:09.552585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d97ffa33-7284-475d-bd49-398167b1351a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:09.553770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d97ffa33-7284-475d-bd49-398167b1351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:09.620139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 31/59] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:09.645521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c6d7b-0961-47db-b381-8aee3061358f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:09.856487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c6d7b-0961-47db-b381-8aee3061358f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:09.873468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:09.889928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ece0aa-4ab7-4fc3-9a48-b9d1c373b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:09.890710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ece0aa-4ab7-4fc3-9a48-b9d1c373b4af None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:09.890990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ece0aa-4ab7-4fc3-9a48-b9d1c373b4af None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:09.891267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ece0aa-4ab7-4fc3-9a48-b9d1c373b4af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:09.892452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ece0aa-4ab7-4fc3-9a48-b9d1c373b4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:09.893980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ece0aa-4ab7-4fc3-9a48-b9d1c373b4af None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:09.895899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 29/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:09.901495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ffa33-7284-475d-bd49-398167b1351a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:09.996930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ffa33-7284-475d-bd49-398167b1351a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:10.028960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9054-5b98-4333-b545-edaf5902981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:10.029615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9054-5b98-4333-b545-edaf5902981a None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:10.029897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9054-5b98-4333-b545-edaf5902981a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:10.030173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9054-5b98-4333-b545-edaf5902981a None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:10.030882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9054-5b98-4333-b545-edaf5902981a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:10.032337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9054-5b98-4333-b545-edaf5902981a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:10.043106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:10.141624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 32/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:58:09 2022] POST /identity/v3/users => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:13.773199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d48d-9aa1-468d-932c-f011f4d95e54 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:13.774196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d48d-9aa1-468d-932c-f011f4d95e54 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:13.774697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d48d-9aa1-468d-932c-f011f4d95e54 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:13.776562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 30/62] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:13.781654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c284a-4d49-45d2-ba0a-b50171f1572f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:13.782449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c284a-4d49-45d2-ba0a-b50171f1572f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:13.783008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c284a-4d49-45d2-ba0a-b50171f1572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:13.805261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cb5c284a-4d49-45d2-ba0a-b50171f1572f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:13.806802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cb5c284a-4d49-45d2-ba0a-b50171f1572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:13.898614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 33/63] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:13.920043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd420-4ef1-47b9-b40f-08974c254d05 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:13.920679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd420-4ef1-47b9-b40f-08974c254d05 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:13.921151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd420-4ef1-47b9-b40f-08974c254d05 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:13.922835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 31/64] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:13.928170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd420-4ef1-47b9-b40f-08974c254d05 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:13.928380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1e0f-133a-482c-adc9-80bd65161add None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:13.928899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1e0f-133a-482c-adc9-80bd65161add None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:13.929373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1e0f-133a-482c-adc9-80bd65161add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:13.948052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f2de1e0f-133a-482c-adc9-80bd65161add None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:13.949569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2de1e0f-133a-482c-adc9-80bd65161add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:14.021261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 34/65] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:14.048167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1e0f-133a-482c-adc9-80bd65161add None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.124317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:14.145207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd420-4ef1-47b9-b40f-08974c254d05 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.180340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1e0f-133a-482c-adc9-80bd65161add None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.191443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba27e8d-8d51-4541-b454-1a03ae58cf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.192816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba27e8d-8d51-4541-b454-1a03ae58cf6c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.193260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba27e8d-8d51-4541-b454-1a03ae58cf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.193956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba27e8d-8d51-4541-b454-1a03ae58cf6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.208707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba27e8d-8d51-4541-b454-1a03ae58cf6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9ba27e8d-8d51-4541-b454-1a03ae58cf6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:14.218486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:14.219517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:14.220303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:14.220885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41731816-2fe8-44c6-95f7-dab082f9d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.220975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731816-2fe8-44c6-95f7-dab082f9d39d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.221757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731816-2fe8-44c6-95f7-dab082f9d39d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.222397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731816-2fe8-44c6-95f7-dab082f9d39d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.223450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 32/66] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:14.228932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80fc0-d430-4ce8-9149-df86d8124ed8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.228932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80fc0-d430-4ce8-9149-df86d8124ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.228932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80fc0-d430-4ce8-9149-df86d8124ed8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.228932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 33/67] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:14.228932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7147-523d-4c3f-a5a6-2b1136bd69d5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.228932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7147-523d-4c3f-a5a6-2b1136bd69d5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.229362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7147-523d-4c3f-a5a6-2b1136bd69d5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.230580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 34/68] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:14.231269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7147-523d-4c3f-a5a6-2b1136bd69d5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.243216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41731816-2fe8-44c6-95f7-dab082f9d39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-41731816-2fe8-44c6-95f7-dab082f9d39d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:14.253310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:14.254180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:14.254980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:14.256406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8deda-fc14-4be7-b614-dfb450536f88 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.256926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8deda-fc14-4be7-b614-dfb450536f88 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.257638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8deda-fc14-4be7-b614-dfb450536f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.278769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2bb8deda-fc14-4be7-b614-dfb450536f88 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:14.280433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2bb8deda-fc14-4be7-b614-dfb450536f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:14.283024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:14.340912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7147-523d-4c3f-a5a6-2b1136bd69d5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.355065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 36/70] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:14.356382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3205fc-ddfa-4e56-a18d-1ffbe1a3fd21 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.356670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3205fc-ddfa-4e56-a18d-1ffbe1a3fd21 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.356944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3205fc-ddfa-4e56-a18d-1ffbe1a3fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.373613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3d3205fc-ddfa-4e56-a18d-1ffbe1a3fd21 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:14.375183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3d3205fc-ddfa-4e56-a18d-1ffbe1a3fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:14.388701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.389374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.389723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.389939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.390694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:14.391200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:14.392391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:14.401792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:14.402624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.419966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:14.453944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 37/72] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:14.454724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3205fc-ddfa-4e56-a18d-1ffbe1a3fd21 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.514237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7436b6-5479-4d73-8a13-b6ebf916892b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.523823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:14.548664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.549391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.549725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.550005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.550756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:14.551063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:14.552528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:14.554908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3205fc-ddfa-4e56-a18d-1ffbe1a3fd21 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.561922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:14.562553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.595030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d885b-f785-434a-9093-d12a29fe7115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.595838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d885b-f785-434a-9093-d12a29fe7115 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.596123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d885b-f785-434a-9093-d12a29fe7115 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.596430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d885b-f785-434a-9093-d12a29fe7115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.608799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d885b-f785-434a-9093-d12a29fe7115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-644d885b-f785-434a-9093-d12a29fe7115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:14.616949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:14.617822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:14.618591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:14.619397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd422d-e361-4be1-9e10-e21c6adb51b6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.619704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd422d-e361-4be1-9e10-e21c6adb51b6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.619982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd422d-e361-4be1-9e10-e21c6adb51b6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.621236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 39/75] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:14.621938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd422d-e361-4be1-9e10-e21c6adb51b6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.653876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:14.667157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342417-1753-456d-85d3-303d0a65d3d7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.701153 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.702024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.702305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.702603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.717132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:14.718503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:14.720161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:14.724147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd422d-e361-4be1-9e10-e21c6adb51b6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.724406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.751666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:14.757650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570990-484c-4218-a230-fa82c712503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.763881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570990-484c-4218-a230-fa82c712503f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.763881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570990-484c-4218-a230-fa82c712503f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.763881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570990-484c-4218-a230-fa82c712503f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.770511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f570990-484c-4218-a230-fa82c712503f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6f570990-484c-4218-a230-fa82c712503f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:14.778200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:14.779199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:14.779979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 40/77] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:14.780661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570990-484c-4218-a230-fa82c712503f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.827927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fceab-6584-44d3-80b0-5c4b4ee9941e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.861084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cb08f-442b-4c0d-9051-bb758c2a639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.862105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb08f-442b-4c0d-9051-bb758c2a639a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.862400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb08f-442b-4c0d-9051-bb758c2a639a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.862662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb08f-442b-4c0d-9051-bb758c2a639a None admin] PATH_INFO: `/v3/users/173c08a245ff42c4826381dd87480484` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.863855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cb08f-442b-4c0d-9051-bb758c2a639a None admin] RBAC: Authorizing `identity:get_user(user_id=173c08a245ff42c4826381dd87480484)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:14.865310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cb08f-442b-4c0d-9051-bb758c2a639a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:14.866926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 38/78] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/users/173c08a245ff42c4826381dd87480484 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:14.868043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf1386-12a2-4339-b95e-a5ca961ba0ca None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.868352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf1386-12a2-4339-b95e-a5ca961ba0ca None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.868622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf1386-12a2-4339-b95e-a5ca961ba0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.876040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:14.884413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bcaf1386-12a2-4339-b95e-a5ca961ba0ca None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:14.888090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570990-484c-4218-a230-fa82c712503f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:14.888217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bcaf1386-12a2-4339-b95e-a5ca961ba0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:14.919480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:14.920135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:14.920446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:14.920725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:14.921470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:14.921777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:14.923148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:14.930963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 41/79] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:14.930963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.955059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 39/80] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:14.957027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf1386-12a2-4339-b95e-a5ca961ba0ca None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:14.983552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.031868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513d987-07f1-4f8c-920f-b1abb5ae46ac None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.059269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf1386-12a2-4339-b95e-a5ca961ba0ca None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.065779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.066547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.066839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.067124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.090540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.097212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.097954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.098208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.098485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.101361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:15.101361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.101361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.108961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 40/81] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:15.109748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.134632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.136095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.198325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.210115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965af8-9e24-4499-9c2b-b43fdc99f0e1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.236406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 42/82] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:15.238409 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.244616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.245263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.245546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.245823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.295942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.312135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.313629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.339652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e77ba-96ea-496a-b2c7-fd3aa8b15caf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.373606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.374465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.374747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.375024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.376250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.377821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.379560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 43/83] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:15.380353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.401602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.414863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 41/84] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:15.415757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.482154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406c3f-9477-41d6-8731-0a312e59da56 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.506154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.517366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.517910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e07cc-5bf8-4125-a206-dc2d00113e34 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.519023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.519306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.519837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.521235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.522719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.524410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 44/85] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:15.526257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.555821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.556714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.556993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.557262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.558442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.559889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.561567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 42/86] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:15.562325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.617950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.630446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c1ca4-eecf-406a-9b09-19f6a25b4b47 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.661431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f2edb-125f-4dda-a13e-d4dc91da21ba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.664681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.665542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.665832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.666114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.667335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.668834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.670542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 45/87] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:15.671309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.694228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.694869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.695150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.695425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.731803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.762021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.763478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.774020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ec0c-2920-4f10-8749-12b656fbaf7c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.806996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.807841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.808126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.808434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.809605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.811030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.812764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 46/88] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:15.814492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.818118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.864094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 43/89] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:15.865593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:15.920376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3db7-05fc-4895-b313-7ec081e208a2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:15.945305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:15.953875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:15.954544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:15.954834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:15.956206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:15.956873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:15.958324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:15.967775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf65c-b03f-43d0-9640-ceb2fb9268f6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:16.000983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:16.001643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:16.001933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:16.002218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:16.027187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:16.044757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 47/90] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:58:15 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:16.045591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:16.072074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:16.073645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:16.156472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6076fa-91d3-4508-aa3e-cd14b1b935c9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:16.194207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:16.194608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 44/91] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:16.194872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:16.195160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:16.195441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:16.195528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:16.196517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=f3095d000b9e4c71ac3c8d00210c3718) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:16.196683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:16.198096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:16.204022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 48/92] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:16 2022] GET /identity/v3/role_assignments?user.id=f3095d000b9e4c71ac3c8d00210c3718&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:16.204865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:16.270903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:16.274636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:16.337801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152112-cfce-487a-8c54-b19666416b82 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:16.348827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847561-c3a5-4c7d-98e3-0983bdb095b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:16.391967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:16.392694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:16.393599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:16.394115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:16.394227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:16.394714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:16.395003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:16.395192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:16.396349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=173c08a245ff42c4826381dd87480484) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:16.396586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:16.397103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:16.398056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:16.398568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:16.400327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:16 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:16.401115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:16.405266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 45/94] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:16 2022] GET /identity/v3/role_assignments?user.id=173c08a245ff42c4826381dd87480484&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:16.407226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:16.535238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869c1b0-d716-42db-86a2-4469a4cf453a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:16.543512 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b1013-1af4-4295-90f3-7426a3d54db5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:16.550499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:16.577273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:16.584082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:16.585303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:16.585602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:16.585887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] PATH_INFO: `/v3/projects/79e59a483c074c5d9aa1043296f81b5a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:16.587469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] RBAC: Authorizing `identity:get_project(project_id=79e59a483c074c5d9aa1043296f81b5a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:16.589745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a20809-91f8-4efb-9f53-beb34c3c0a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:16.590737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:16.590938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20809-91f8-4efb-9f53-beb34c3c0a54 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:16.591378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20809-91f8-4efb-9f53-beb34c3c0a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:16.591816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20809-91f8-4efb-9f53-beb34c3c0a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:16.592864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a20809-91f8-4efb-9f53-beb34c3c0a54 None admin] RBAC: Adding query filter params (role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=f3095d000b9e4c71ac3c8d00210c3718) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:16.592968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 50/95] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:16 2022] GET /identity/v3/projects/79e59a483c074c5d9aa1043296f81b5a => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:16.600343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a20809-91f8-4efb-9f53-beb34c3c0a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:16.600343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a20809-91f8-4efb-9f53-beb34c3c0a54 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:16.606576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 46/96] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:16 2022] GET /identity/v3/role_assignments?user.id=f3095d000b9e4c71ac3c8d00210c3718&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:16.609005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:16.742134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf22967-1420-498a-82d9-e5df066e0451 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:16.798024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d06a3-397e-49fe-a3ea-b179f2ffc19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:16.799085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d06a3-397e-49fe-a3ea-b179f2ffc19d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:16.800118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d06a3-397e-49fe-a3ea-b179f2ffc19d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:16.800626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d06a3-397e-49fe-a3ea-b179f2ffc19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:16.801707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d06a3-397e-49fe-a3ea-b179f2ffc19d None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=79e59a483c074c5d9aa1043296f81b5a, user.id=f3095d000b9e4c71ac3c8d00210c3718) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:16.802286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d06a3-397e-49fe-a3ea-b179f2ffc19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:16.804016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d06a3-397e-49fe-a3ea-b179f2ffc19d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:16.817864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 51/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:16 2022] GET /identity/v3/role_assignments?user.id=f3095d000b9e4c71ac3c8d00210c3718&scope.project.id=79e59a483c074c5d9aa1043296f81b5a&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:19.017474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e98ae-4ec4-420e-b240-4d623ad2acd9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.020352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e98ae-4ec4-420e-b240-4d623ad2acd9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.021125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e98ae-4ec4-420e-b240-4d623ad2acd9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.023938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 47/98] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:19.032407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c781df-784f-4991-8967-a2e25a252f5f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.034048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c781df-784f-4991-8967-a2e25a252f5f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.034814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c781df-784f-4991-8967-a2e25a252f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.068776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-53c781df-784f-4991-8967-a2e25a252f5f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:19.071105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-53c781df-784f-4991-8967-a2e25a252f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:19.167958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:19.221474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 52/99] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:19.287517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e98ae-4ec4-420e-b240-4d623ad2acd9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:19.433230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492874-4ba2-4ebe-a295-ccf6a608afb9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.434182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492874-4ba2-4ebe-a295-ccf6a608afb9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.434970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492874-4ba2-4ebe-a295-ccf6a608afb9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.437757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 53/100] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:19.444490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633167b2-4d5e-457a-86cd-376adb757f97 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.445266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633167b2-4d5e-457a-86cd-376adb757f97 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.446023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633167b2-4d5e-457a-86cd-376adb757f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.484659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-633167b2-4d5e-457a-86cd-376adb757f97 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:19.486559 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-633167b2-4d5e-457a-86cd-376adb757f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:19.498723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e98ae-4ec4-420e-b240-4d623ad2acd9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:19.569710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986f5db-4038-46f4-90d3-d1a5f958560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:19.570845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986f5db-4038-46f4-90d3-d1a5f958560e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.571470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986f5db-4038-46f4-90d3-d1a5f958560e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.571942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986f5db-4038-46f4-90d3-d1a5f958560e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.595250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986f5db-4038-46f4-90d3-d1a5f958560e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3986f5db-4038-46f4-90d3-d1a5f958560e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:19.613508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:19.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:19.615244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:19.617036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 48/101] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:19.619030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520070e-1a73-44b1-ad5d-1a56ee30b5bb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.620640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520070e-1a73-44b1-ad5d-1a56ee30b5bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.620927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520070e-1a73-44b1-ad5d-1a56ee30b5bb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.622259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 49/102] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:19.625726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520070e-1a73-44b1-ad5d-1a56ee30b5bb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:19.636441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 54/103] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:19.637751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d93a7-bc27-4ee1-a75f-31d2f689e17e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.638041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d93a7-bc27-4ee1-a75f-31d2f689e17e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.638321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d93a7-bc27-4ee1-a75f-31d2f689e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.671036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b75d93a7-bc27-4ee1-a75f-31d2f689e17e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:19.672235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b75d93a7-bc27-4ee1-a75f-31d2f689e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:19.725617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:19.787808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520070e-1a73-44b1-ad5d-1a56ee30b5bb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:19.806217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 55/104] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:19.807079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d93a7-bc27-4ee1-a75f-31d2f689e17e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:19.834166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:19.834767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:19.835052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:19.835376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:19.836146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:19.836525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:19.838056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:19.855996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 50/105] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:19.856712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:19.897315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:19.979704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9a31d-53cc-4119-8992-cb49034b5169 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:19.988344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:20.023332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.024134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.024439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.024706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.035986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:20.037183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d93a7-bc27-4ee1-a75f-31d2f689e17e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:20.052625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:20.053604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:20.054365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:20.056700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 51/106] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:20.057636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.109023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.109736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.110037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.110294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.111534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:20.113320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:20.115378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 56/107] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:20.116232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.180494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e8b6-d42e-4114-be97-2290ad41517d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.235853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.237419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.238278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.238555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.239780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:20.241278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:20.243095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 52/108] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:20 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:20.243665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.279460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6e32d-a98a-45e1-a5fa-d61e143f7ea6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.279794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:20.282266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:20.313739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061b32a-019d-4427-bf4f-d492be4c7339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.314423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b32a-019d-4427-bf4f-d492be4c7339 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.314712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b32a-019d-4427-bf4f-d492be4c7339 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.315570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b32a-019d-4427-bf4f-d492be4c7339 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.316386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061b32a-019d-4427-bf4f-d492be4c7339 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:20.316701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061b32a-019d-4427-bf4f-d492be4c7339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:20.318080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061b32a-019d-4427-bf4f-d492be4c7339 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:20.326179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 57/109] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:20.327406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e30b-7f3b-45a3-a486-0a25ab6d1b14 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.327694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e30b-7f3b-45a3-a486-0a25ab6d1b14 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.327979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e30b-7f3b-45a3-a486-0a25ab6d1b14 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.329249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 58/110] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:20.330309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdb6b4-0816-4304-a12a-066d92e45c6c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.330634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdb6b4-0816-4304-a12a-066d92e45c6c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.331348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdb6b4-0816-4304-a12a-066d92e45c6c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.332627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 59/111] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:20.336331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdb6b4-0816-4304-a12a-066d92e45c6c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.351853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ada9-c957-429e-b287-936b646d3eca None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.386409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ae69f-74eb-4c68-8653-b6a6eaa28d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.387002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ae69f-74eb-4c68-8653-b6a6eaa28d9c None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.387284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ae69f-74eb-4c68-8653-b6a6eaa28d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.387561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ae69f-74eb-4c68-8653-b6a6eaa28d9c None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.388293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ae69f-74eb-4c68-8653-b6a6eaa28d9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:20.389724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ae69f-74eb-4c68-8653-b6a6eaa28d9c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:20.434843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdb6b4-0816-4304-a12a-066d92e45c6c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.466789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfcdc-f216-4b5b-a3fe-8f541216c8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.467644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfcdc-f216-4b5b-a3fe-8f541216c8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.467929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfcdc-f216-4b5b-a3fe-8f541216c8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.468235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfcdc-f216-4b5b-a3fe-8f541216c8f2 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.469421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbfcdc-f216-4b5b-a3fe-8f541216c8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:20.470884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbfcdc-f216-4b5b-a3fe-8f541216c8f2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:20.473293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 60/112] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:20 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:20.476625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4b54-f032-494c-8536-220359e59df6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.476625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4b54-f032-494c-8536-220359e59df6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.476625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4b54-f032-494c-8536-220359e59df6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.476625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 61/113] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:20.477211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe4b54-f032-494c-8536-220359e59df6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.480567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 53/114] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:58:20 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:20.482789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f482b3-fcb5-4f8a-8a3a-66267d1eba18 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.483000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f482b3-fcb5-4f8a-8a3a-66267d1eba18 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.483278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f482b3-fcb5-4f8a-8a3a-66267d1eba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.503792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-28f482b3-fcb5-4f8a-8a3a-66267d1eba18 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:20.505272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-28f482b3-fcb5-4f8a-8a3a-66267d1eba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:20.518306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:20.597014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 54/115] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:20.608485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe4b54-f032-494c-8536-220359e59df6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.608568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5434db-90f5-4692-b196-75252a3c18d2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.608568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5434db-90f5-4692-b196-75252a3c18d2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.608568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5434db-90f5-4692-b196-75252a3c18d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.632058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1c5434db-90f5-4692-b196-75252a3c18d2 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:20.634045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1c5434db-90f5-4692-b196-75252a3c18d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:20.637463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.638283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.638549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.639640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] PATH_INFO: `/v3/users/d439e3cf2904415e9f0433807c9d0901` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.647297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:20.658442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] RBAC: Authorizing `identity:get_user(user_id=d439e3cf2904415e9f0433807c9d0901)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:20.661200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:20.663157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 62/116] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:20 2022] GET /identity/v3/users/d439e3cf2904415e9f0433807c9d0901 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:20.664571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.716277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 55/117] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:20.716277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a3b71-eaf0-45f4-a0dc-99aa1f98282a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.716277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a3b71-eaf0-45f4-a0dc-99aa1f98282a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.716277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a3b71-eaf0-45f4-a0dc-99aa1f98282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.739849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ca8a3b71-eaf0-45f4-a0dc-99aa1f98282a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:20.741190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ca8a3b71-eaf0-45f4-a0dc-99aa1f98282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:20.768239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:20.778014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b835a-49f3-4df7-a9de-d52853db7174 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.814052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.816374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.816888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.817359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5/users/f3095d000b9e4c71ac3c8d00210c3718/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.818155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 56/118] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:20.828405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a3b71-eaf0-45f4-a0dc-99aa1f98282a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.828500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] RBAC: Authorizing `identity:create_grant(project_id=12617164ba504ce18054575cb49f5cd5, user_id=f3095d000b9e4c71ac3c8d00210c3718, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:20.828500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:20.897373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:20.915448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 63/119] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:20 2022] PUT /identity/v3/projects/12617164ba504ce18054575cb49f5cd5/users/f3095d000b9e4c71ac3c8d00210c3718/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:20.916318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:20.927892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a3b71-eaf0-45f4-a0dc-99aa1f98282a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:20.972092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:20.973494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:20.974233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:20.974787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:20.989625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:20.998701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:20.999637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:21.000487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:21.003349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 57/120] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:21.009647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.056000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f66c-0542-4304-adc1-67bbc2dc1010 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.094483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.095270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.095560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.095889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.121136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:21.137481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9e24-97e5-430b-865a-d053f3789f3c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.172753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:21.172919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:21.184050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.185809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.186598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.187079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.196671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:21.204189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:21.215127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:21.216028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:21.216832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:21.220218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 58/121] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:21.222146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.303843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 64/122] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:21.305120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.333668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e23d74-3ef8-4046-a9e1-be3a84e622cd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.372150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:21.381308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.382936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.383438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.383998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.406745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:21.410443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:21.411522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:21.412337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 59/123] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:21.413529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.420487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414a57a-0dec-47c9-b097-429641e3db2c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.457531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.458225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.458571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.458934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.459748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:21.460118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:21.461598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:21.470075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 65/124] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:21.474830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.503024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:21.557233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d46de-a1a2-42dd-bb2c-e81ff2ea0c04 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.594758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb863-d41e-46f6-8566-2a2826d2ae81 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.604736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.607300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.607766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.608312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.609309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:21.609794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:21.611358 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:21.613627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:21.621322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 60/125] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:21.622413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.639189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.640991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.641286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.641569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.643717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:21.645705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:21.647842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 66/126] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:21.648637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.756251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675d201-9075-4802-991c-d1fef12bd51c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.775120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f9dc-7371-453c-a8fd-0c57527659a7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.779986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:21.803426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.804467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.806647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.806935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.807704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:21.808017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:21.809430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:21.815025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.816301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.817362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.817840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.819507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:21.820523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 61/127] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:21.821195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.821927 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:21.824129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 67/128] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:21.829213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.899713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:21.941854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfce5c4-fd78-45f1-8898-34491466436e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.954186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c01911-2700-4976-8d4f-de02552a8842 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:21.981527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.982400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.982685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.983034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] PATH_INFO: `/v3/users/173c08a245ff42c4826381dd87480484` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:21.984292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] RBAC: Authorizing `identity:get_user(user_id=173c08a245ff42c4826381dd87480484)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:21.985761 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:21.987755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 62/129] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/users/173c08a245ff42c4826381dd87480484 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:21.988499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:21.998493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:21.999014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:21.999307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:21.999588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.000481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] RBAC: Adding query filter params (role.id=7dabad7a1cff40a59c9820e02e0de925, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=d439e3cf2904415e9f0433807c9d0901) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:22.000802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:22.002878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:22.008999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 68/130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/role_assignments?user.id=d439e3cf2904415e9f0433807c9d0901&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=7dabad7a1cff40a59c9820e02e0de925 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:22.009753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:22.094205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:22.199359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3cf71-793e-42b0-8ff8-f81076385156 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:22.225562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cca22-2408-4b7a-a3f0-9e7f91625fde None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:22.235435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37281876-a658-4703-a404-abc133f24598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:22.236403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37281876-a658-4703-a404-abc133f24598 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.237277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37281876-a658-4703-a404-abc133f24598 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.237704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37281876-a658-4703-a404-abc133f24598 None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.238966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37281876-a658-4703-a404-abc133f24598 None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:22.240461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37281876-a658-4703-a404-abc133f24598 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:22.242327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 63/131] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:21 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:22.243108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37281876-a658-4703-a404-abc133f24598 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:22.254815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:22.289274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:22.290155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.290440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.290718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] PATH_INFO: `/v3/projects/79e59a483c074c5d9aa1043296f81b5a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.294840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] RBAC: Authorizing `identity:get_project(project_id=79e59a483c074c5d9aa1043296f81b5a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:22.296332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:22.300398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 69/132] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:22 2022] GET /identity/v3/projects/79e59a483c074c5d9aa1043296f81b5a => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:22.301187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:22.409043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37281876-a658-4703-a404-abc133f24598 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:22.429119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:22.448661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:22.449581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.449874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.450155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.451381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:22.452867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:22.455229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 64/133] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:22 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:22.456046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:22.508935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba9da3-d37c-4e06-90b2-6d7e1d57dc7d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:22.577135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:22.577938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.578222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.578498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.579854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:22.581418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:22.583180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 70/134] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:22 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:22.584993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:22.639846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5c866-65f4-4e73-89ed-920fa652a9ef None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:22.669324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:22.701560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:22.702819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.703301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.703812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] PATH_INFO: `/v3/projects/79e59a483c074c5d9aa1043296f81b5a/users/f3095d000b9e4c71ac3c8d00210c3718/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.711525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] RBAC: Authorizing `identity:create_grant(project_id=79e59a483c074c5d9aa1043296f81b5a, user_id=f3095d000b9e4c71ac3c8d00210c3718, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:22.713360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:22.742863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0bdae-9757-4ca2-8b3c-0838f8f1024c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:22.778664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b15efa-d472-45f4-972f-b36c33e62887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:22.779899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15efa-d472-45f4-972f-b36c33e62887 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.780472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15efa-d472-45f4-972f-b36c33e62887 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.780966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b15efa-d472-45f4-972f-b36c33e62887 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5/users/173c08a245ff42c4826381dd87480484/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.783162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b15efa-d472-45f4-972f-b36c33e62887 None admin] RBAC: Authorizing `identity:create_grant(project_id=12617164ba504ce18054575cb49f5cd5, user_id=173c08a245ff42c4826381dd87480484, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:22.785663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b15efa-d472-45f4-972f-b36c33e62887 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:22.863634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 65/135] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:22 2022] PUT /identity/v3/projects/79e59a483c074c5d9aa1043296f81b5a/users/f3095d000b9e4c71ac3c8d00210c3718/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:22.872364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:22.909702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 71/136] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:22 2022] PUT /identity/v3/projects/12617164ba504ce18054575cb49f5cd5/users/173c08a245ff42c4826381dd87480484/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:22.911420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00c9f1-998b-42fe-ab5c-44df25542f9b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.911872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00c9f1-998b-42fe-ab5c-44df25542f9b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.912553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00c9f1-998b-42fe-ab5c-44df25542f9b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.914173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 72/137] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:22.929279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508055f-304a-4188-9de4-d7f31b6fde70 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:22.929923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508055f-304a-4188-9de4-d7f31b6fde70 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:22.930451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508055f-304a-4188-9de4-d7f31b6fde70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:22.962021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4508055f-304a-4188-9de4-d7f31b6fde70 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:22.965363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4508055f-304a-4188-9de4-d7f31b6fde70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:22.966051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:23.099532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5237-d450-49da-b5ed-4c091031dbcf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:23.146033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60cd5-145e-4bc7-a73c-c22efdc464ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:23.147270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60cd5-145e-4bc7-a73c-c22efdc464ad None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:23.147747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60cd5-145e-4bc7-a73c-c22efdc464ad None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:23.148244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60cd5-145e-4bc7-a73c-c22efdc464ad None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5/users/f3095d000b9e4c71ac3c8d00210c3718/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:23.151000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60cd5-145e-4bc7-a73c-c22efdc464ad None admin] RBAC: Authorizing `identity:create_grant(project_id=12617164ba504ce18054575cb49f5cd5, user_id=f3095d000b9e4c71ac3c8d00210c3718, role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:23.152802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60cd5-145e-4bc7-a73c-c22efdc464ad None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:23.161748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 73/138] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:23.193475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508055f-304a-4188-9de4-d7f31b6fde70 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:23.253692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:23.288033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 66/139] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:22 2022] PUT /identity/v3/projects/12617164ba504ce18054575cb49f5cd5/users/f3095d000b9e4c71ac3c8d00210c3718/roles/d8548213eacf423fb6e7c5832be20d3b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:23.289443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8a1f-de58-4f0a-87f8-9c50f421466b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:23.289735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8a1f-de58-4f0a-87f8-9c50f421466b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:23.290017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8a1f-de58-4f0a-87f8-9c50f421466b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:23.291827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 67/140] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:23.303074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c421ac-e2a6-4331-ae53-c03f301e99b2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:23.303351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c421ac-e2a6-4331-ae53-c03f301e99b2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:23.303633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c421ac-e2a6-4331-ae53-c03f301e99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:23.344126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-65c421ac-e2a6-4331-ae53-c03f301e99b2 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:23.345393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-65c421ac-e2a6-4331-ae53-c03f301e99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:23.354332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508055f-304a-4188-9de4-d7f31b6fde70 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:23.436645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:23.439670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:23.440048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:23.440359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:23.443825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:23.445383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:23.447164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 74/141] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:23.453034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:23.495723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 68/142] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:23.526519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c421ac-e2a6-4331-ae53-c03f301e99b2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:23.591057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:23.607686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904e9b-77b7-4cc8-a5e1-9c2cf8466b41 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:23.619940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:23.650493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:23.651550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:23.652397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:23.653007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:23.653931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:23.656962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:23.708598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c421ac-e2a6-4331-ae53-c03f301e99b2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:23.762851 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:23.764242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:23.764778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:23.765264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:23.782598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 75/143] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:58:23 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:23.786378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:23.795317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:23.801243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:23.802338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 69/144] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:23.808018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:23.927562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b072-45a5-4c7e-84b2-af428be5f2bc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:23.970594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:23.971912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:23.972451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:23.972954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:23.973943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:23.974460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:23.976295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:23.985865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 76/145] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:23.992227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:24.109778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:24.118528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d179490-1e41-41a7-9bbe-c14285bf52f2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:24.159836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:24.161132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:24.161638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:24.162144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:24.163639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:24.165343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:24.167215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 70/146] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:23 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:24.173897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:24.212569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:24.284316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8ad9-4503-4531-9059-518b1d846295 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:24.321082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:24.321736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:24.322023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:24.322302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:24.393071 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:24.394827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:24.425150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:24.499421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 77/147] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:24.505252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:24.615553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b296b28-4eb9-4874-9dce-b0f05830cfb1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:24.651980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa35ed3-ba5e-4190-899c-32d10c10a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:24.652916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35ed3-ba5e-4190-899c-32d10c10a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:24.653238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35ed3-ba5e-4190-899c-32d10c10a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:24.653520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35ed3-ba5e-4190-899c-32d10c10a1d8 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:24.654905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa35ed3-ba5e-4190-899c-32d10c10a1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:24.656439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa35ed3-ba5e-4190-899c-32d10c10a1d8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:24.658679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 71/148] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:24 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:24.665169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:24.772824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57b6d8-fdae-432d-a39c-550b228d121c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:24.794171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19643ca-e24d-47cf-92c4-e41d7249866e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:24.794472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19643ca-e24d-47cf-92c4-e41d7249866e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:24.794737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19643ca-e24d-47cf-92c4-e41d7249866e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:24.796132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 72/149] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:24.801642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a247d-3504-4c1c-8f7f-a7c456e56816 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:24.801928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a247d-3504-4c1c-8f7f-a7c456e56816 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:24.802219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a247d-3504-4c1c-8f7f-a7c456e56816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:24.820555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:24.826835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9c2a247d-3504-4c1c-8f7f-a7c456e56816 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:24.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9c2a247d-3504-4c1c-8f7f-a7c456e56816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:24.850820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:24.850820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:24.850820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:24.850820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:24.851211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=f3095d000b9e4c71ac3c8d00210c3718) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:24.851211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:24.851211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:24.852998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 78/150] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:24 2022] GET /identity/v3/role_assignments?user.id=f3095d000b9e4c71ac3c8d00210c3718&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:24.868002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:24.938752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 73/151] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:24.982840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:25.114887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a6d3-87ff-4291-80d9-8ad11ccc74a9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:25.155360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:25.156545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:25.157054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:25.157530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:25.168693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:25.176945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:25.177820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:25.178618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:25.181159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 79/152] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:25.187191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a247d-3504-4c1c-8f7f-a7c456e56816 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:25.315571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a247d-3504-4c1c-8f7f-a7c456e56816 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:25.359395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:25.360104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:25.360416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:25.360692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:25.361447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:25.362298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:25.363711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:25.372847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 74/153] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:25.379141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:25.449399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:25.509020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fffc8-c32c-4dbe-b2b1-93795aaa7f43 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:25.550483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:25.551397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:25.551692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:25.551969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] PATH_INFO: `/v3/users/d439e3cf2904415e9f0433807c9d0901` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:25.553255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] RBAC: Authorizing `identity:get_user(user_id=d439e3cf2904415e9f0433807c9d0901)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:25.554729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:25.556423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 80/154] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:25 2022] GET /identity/v3/users/d439e3cf2904415e9f0433807c9d0901 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:25.562112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:25.607181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:25.711545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed35a-d222-48d7-b68a-9aaf1c9ddf99 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:25.748255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d68f9-c9b4-46e5-97ee-379e4f1efe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:25.749142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d68f9-c9b4-46e5-97ee-379e4f1efe32 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:25.749412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d68f9-c9b4-46e5-97ee-379e4f1efe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:25.749689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d68f9-c9b4-46e5-97ee-379e4f1efe32 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:25.750930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d68f9-c9b4-46e5-97ee-379e4f1efe32 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:25.752594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d68f9-c9b4-46e5-97ee-379e4f1efe32 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:25.754574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 75/155] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:25 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:25.760415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:25.894501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c4aa-eb57-4063-8c20-fe748f0963b0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:25.915818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:25.934550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962204d0-e578-4fa6-a1f3-3e20bb1538df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:25.935454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962204d0-e578-4fa6-a1f3-3e20bb1538df None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:25.935734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962204d0-e578-4fa6-a1f3-3e20bb1538df None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:25.936008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962204d0-e578-4fa6-a1f3-3e20bb1538df None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5/users/d439e3cf2904415e9f0433807c9d0901/roles/7dabad7a1cff40a59c9820e02e0de925` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:25.941549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962204d0-e578-4fa6-a1f3-3e20bb1538df None admin] RBAC: Authorizing `identity:create_grant(project_id=12617164ba504ce18054575cb49f5cd5, user_id=d439e3cf2904415e9f0433807c9d0901, role_id=7dabad7a1cff40a59c9820e02e0de925)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:25.943020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962204d0-e578-4fa6-a1f3-3e20bb1538df None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:26.034625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 81/156] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:25 2022] PUT /identity/v3/projects/12617164ba504ce18054575cb49f5cd5/users/d439e3cf2904415e9f0433807c9d0901/roles/7dabad7a1cff40a59c9820e02e0de925 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:26.059525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff3e4-812e-4404-ac4b-641e16962766 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.059861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff3e4-812e-4404-ac4b-641e16962766 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.060085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff3e4-812e-4404-ac4b-641e16962766 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.061820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 76/157] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:26.067117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90300e0e-4f5b-4fe9-97e2-a6d7709a597d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.067404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90300e0e-4f5b-4fe9-97e2-a6d7709a597d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.067687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90300e0e-4f5b-4fe9-97e2-a6d7709a597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.093646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-90300e0e-4f5b-4fe9-97e2-a6d7709a597d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:26.094856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90300e0e-4f5b-4fe9-97e2-a6d7709a597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:26.181110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 82/158] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:26.217241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff3e4-812e-4404-ac4b-641e16962766 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:26.348699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:26.362014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff3e4-812e-4404-ac4b-641e16962766 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:26.403786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb6f0-acbd-472c-aa75-9a1d42c3aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:26.404614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb6f0-acbd-472c-aa75-9a1d42c3aace None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.404899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb6f0-acbd-472c-aa75-9a1d42c3aace None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.405177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb6f0-acbd-472c-aa75-9a1d42c3aace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.418063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eb6f0-acbd-472c-aa75-9a1d42c3aace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6d7eb6f0-acbd-472c-aa75-9a1d42c3aace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:26.425862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:26.426735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:26.428079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 77/159] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:26.433205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90300e0e-4f5b-4fe9-97e2-a6d7709a597d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:26.454806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f74629-7745-4155-9f54-25a1b19309da None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.455124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f74629-7745-4155-9f54-25a1b19309da None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.455365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f74629-7745-4155-9f54-25a1b19309da None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.457665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 78/160] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:26.464155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a541d-c1e6-485d-9349-367699d7f57b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.464547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a541d-c1e6-485d-9349-367699d7f57b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.464899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a541d-c1e6-485d-9349-367699d7f57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.490424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c49a541d-c1e6-485d-9349-367699d7f57b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:26.491635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c49a541d-c1e6-485d-9349-367699d7f57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:26.575966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90300e0e-4f5b-4fe9-97e2-a6d7709a597d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:26.587882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:26.602853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 79/161] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:26.625433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd3661-c186-435a-8da7-a1859aaf6d66 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.625736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd3661-c186-435a-8da7-a1859aaf6d66 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.625988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd3661-c186-435a-8da7-a1859aaf6d66 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.626276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:26.626956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.627241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.628058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.628331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 80/162] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:26.628874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:26.629183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:26.630592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:26.633230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3315-9d8c-40a6-ab6c-adae96206335 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.633523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3315-9d8c-40a6-ab6c-adae96206335 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.639480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3315-9d8c-40a6-ab6c-adae96206335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.648073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 83/163] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:26.649002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:26.655062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-914e3315-9d8c-40a6-ab6c-adae96206335 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:26.656815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-914e3315-9d8c-40a6-ab6c-adae96206335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:26.734629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 81/164] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:26.735611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3315-9d8c-40a6-ab6c-adae96206335 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:26.759009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:26.853479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73d922-a423-4928-9b3e-4ca2c3ef3338 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:26.925325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:26.926213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.926496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.926771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.934253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3315-9d8c-40a6-ab6c-adae96206335 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:26.953128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:26.961491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:26.963570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 84/165] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:26.965632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:26.990291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:26.991174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:26.991453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:26.991730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] PATH_INFO: `/v3/users/173c08a245ff42c4826381dd87480484` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:26.993007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] RBAC: Authorizing `identity:get_user(user_id=173c08a245ff42c4826381dd87480484)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:26.994466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:26.996432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 82/166] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:26 2022] GET /identity/v3/users/173c08a245ff42c4826381dd87480484 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:26.997246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:27.022868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:27.082735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:27.106729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30131850-85d5-49de-8eb5-001dcbb38a70 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:27.124539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9397c-dfbf-44dd-a102-33a09efd89d3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:27.177629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:27.178306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:27.178590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:27.178867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:27.180271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:27.180584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:27.182467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:27.184988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:27.185791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:27.186074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:27.186350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:27.203651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 83/167] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:27.204529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:27.205471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:27.222342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:27.224606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 85/168] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:27.226651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:27.352992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d4a0-fb6d-4772-b9eb-a3187ad9414f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:27.376396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:27.384085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223fcc-9095-4520-924e-14ce81b0163a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:27.399933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:27.400706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:27.401055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:27.401403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:27.413052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:27.453452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:27.454339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:27.454617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:27.454889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:27.456888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:27.458339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:27.460294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 86/169] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:27 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:27.461069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:27.476277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:27.477778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:27.590374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 84/170] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:27.590374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:27.631166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:27.663327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d527-868a-4d9e-bb73-c1f8e999c001 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:27.693231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8948d9-f8a4-4125-b664-1cf3c5b0f5ef None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:27.729586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:27.730329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:27.730617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:27.730889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:27.735214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:27.735892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:27.736179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:27.736480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:27.737794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:27.738106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:27.739494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:27.759932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 87/171] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:27.760922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:27.801506 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:27.806711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:27.808358 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:27.852573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:27.917640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 85/172] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:27.918189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:27.967128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0043c6-e8f5-4c9c-ac10-b46c401ea703 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.022816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8a6a2-0b38-461c-a911-815e662728c3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.033187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774db61-3045-4145-afdd-1e8a57481f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.034701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774db61-3045-4145-afdd-1e8a57481f29 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.034992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774db61-3045-4145-afdd-1e8a57481f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.035272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774db61-3045-4145-afdd-1e8a57481f29 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.041034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774db61-3045-4145-afdd-1e8a57481f29 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:28.042638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774db61-3045-4145-afdd-1e8a57481f29 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:28.044529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 88/173] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:27 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:28.045760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764728-29de-4595-ae44-9e3207f9c382 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.046050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764728-29de-4595-ae44-9e3207f9c382 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.046331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764728-29de-4595-ae44-9e3207f9c382 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.047804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 89/174] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:28.048534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764728-29de-4595-ae44-9e3207f9c382 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:28.059426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.060484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.060767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.061042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] PATH_INFO: `/v3/users/f3095d000b9e4c71ac3c8d00210c3718` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.062348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] RBAC: Authorizing `identity:get_user(user_id=f3095d000b9e4c71ac3c8d00210c3718)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:28.063857 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:28.065585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 86/175] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:27 2022] GET /identity/v3/users/f3095d000b9e4c71ac3c8d00210c3718 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:28.066348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:28.077351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:28.183383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe12f15-4f73-4a34-b231-303efc4d8376 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.218875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e1d73-866e-45b4-8f9b-37b52c9e2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.219630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e1d73-866e-45b4-8f9b-37b52c9e2a0d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.219981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e1d73-866e-45b4-8f9b-37b52c9e2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.220447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e1d73-866e-45b4-8f9b-37b52c9e2a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.222052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e1d73-866e-45b4-8f9b-37b52c9e2a0d None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=173c08a245ff42c4826381dd87480484) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:28.222501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e1d73-866e-45b4-8f9b-37b52c9e2a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:28.224072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e1d73-866e-45b4-8f9b-37b52c9e2a0d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:28.230850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 87/176] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:28 2022] GET /identity/v3/role_assignments?user.id=173c08a245ff42c4826381dd87480484&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:28.232047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db4cf-a819-4a15-8a22-bc95c701fd98 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.232424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db4cf-a819-4a15-8a22-bc95c701fd98 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.232771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db4cf-a819-4a15-8a22-bc95c701fd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.252224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-df9db4cf-a819-4a15-8a22-bc95c701fd98 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:28.253755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-df9db4cf-a819-4a15-8a22-bc95c701fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:28.256588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:28.281244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764728-29de-4595-ae44-9e3207f9c382 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.337184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 88/177] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:28.337962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db4cf-a819-4a15-8a22-bc95c701fd98 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:28.340715 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:28.350424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.351309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.351594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.351871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.357068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:28.358726 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:28.362417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 90/178] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:28 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:28.366630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:28.455230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db4cf-a819-4a15-8a22-bc95c701fd98 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.495321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.496049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.496368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.496724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.575315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:28.579222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:28.579222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:28.642364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bce3d3-2a01-46c4-a0a5-6df18122c765 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.689120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 89/179] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:28.695652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:28.708184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65309b5-11d6-4990-ac30-9f8ed2cef93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.709123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65309b5-11d6-4990-ac30-9f8ed2cef93f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.709541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65309b5-11d6-4990-ac30-9f8ed2cef93f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.709951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65309b5-11d6-4990-ac30-9f8ed2cef93f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.711024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65309b5-11d6-4990-ac30-9f8ed2cef93f None admin] RBAC: Adding query filter params (role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=f3095d000b9e4c71ac3c8d00210c3718) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:28.711518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65309b5-11d6-4990-ac30-9f8ed2cef93f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:28.713116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65309b5-11d6-4990-ac30-9f8ed2cef93f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:28.722451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 91/180] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:28 2022] GET /identity/v3/role_assignments?user.id=f3095d000b9e4c71ac3c8d00210c3718&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:28.724692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2843bbe-1f79-4f1b-99b0-a0f79ec4007b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.725390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2843bbe-1f79-4f1b-99b0-a0f79ec4007b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.732557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2843bbe-1f79-4f1b-99b0-a0f79ec4007b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.732557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 92/181] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:28.732557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2843bbe-1f79-4f1b-99b0-a0f79ec4007b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:28.776397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:28.872337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f904520-0b83-454f-9f6b-3ba9791c04f8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.877229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:28.935254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2843bbe-1f79-4f1b-99b0-a0f79ec4007b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:28.952006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae504c48-d707-491c-a9c1-60bd8edce2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.952983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae504c48-d707-491c-a9c1-60bd8edce2ab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.953262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae504c48-d707-491c-a9c1-60bd8edce2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.953534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae504c48-d707-491c-a9c1-60bd8edce2ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.967340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae504c48-d707-491c-a9c1-60bd8edce2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ae504c48-d707-491c-a9c1-60bd8edce2ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:28.976283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:28.977375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:28.978193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 90/182] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:28.979141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca0f47-fcfe-44ca-bfbd-7c2661abaf18 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.979827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca0f47-fcfe-44ca-bfbd-7c2661abaf18 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.980509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca0f47-fcfe-44ca-bfbd-7c2661abaf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.987353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53c929-7672-48f8-9bc5-e95b19f079b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:28.989287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c929-7672-48f8-9bc5-e95b19f079b4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.989287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c929-7672-48f8-9bc5-e95b19f079b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.989287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c929-7672-48f8-9bc5-e95b19f079b4 None admin] PATH_INFO: `/v3/projects/79e59a483c074c5d9aa1043296f81b5a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.990560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53c929-7672-48f8-9bc5-e95b19f079b4 None admin] RBAC: Authorizing `identity:get_project(project_id=79e59a483c074c5d9aa1043296f81b5a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:28.992180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53c929-7672-48f8-9bc5-e95b19f079b4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:28.994036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 93/183] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:28 2022] GET /identity/v3/projects/79e59a483c074c5d9aa1043296f81b5a => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:28.995594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee488111-a8e3-43ab-979c-7d2acc78ba49 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:28.995901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee488111-a8e3-43ab-979c-7d2acc78ba49 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:28.996140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee488111-a8e3-43ab-979c-7d2acc78ba49 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:28.997605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 94/184] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:28.998146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee488111-a8e3-43ab-979c-7d2acc78ba49 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.008470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f8ca0f47-fcfe-44ca-bfbd-7c2661abaf18 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:29.009646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f8ca0f47-fcfe-44ca-bfbd-7c2661abaf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:29.090660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 91/185] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:29.091744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca0f47-fcfe-44ca-bfbd-7c2661abaf18 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.114650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:29.132074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee488111-a8e3-43ab-979c-7d2acc78ba49 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.171336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f9efb-5e4b-4345-9de6-5a860876e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.172111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9efb-5e4b-4345-9de6-5a860876e3db None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.172492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9efb-5e4b-4345-9de6-5a860876e3db None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.172774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9efb-5e4b-4345-9de6-5a860876e3db None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.173532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9efb-5e4b-4345-9de6-5a860876e3db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:29.173829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9efb-5e4b-4345-9de6-5a860876e3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:29.175896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9efb-5e4b-4345-9de6-5a860876e3db None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:29.184751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 95/186] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:29.185751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816a86-9d23-46c8-b107-25fb39a484f3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.186040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816a86-9d23-46c8-b107-25fb39a484f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.186314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816a86-9d23-46c8-b107-25fb39a484f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.196925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:29.203371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-79816a86-9d23-46c8-b107-25fb39a484f3 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:29.204479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-79816a86-9d23-46c8-b107-25fb39a484f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:29.206224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca0f47-fcfe-44ca-bfbd-7c2661abaf18 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.242122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.242731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.243016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.243291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.244123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=79e59a483c074c5d9aa1043296f81b5a, user.id=f3095d000b9e4c71ac3c8d00210c3718) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:29.244463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:29.245891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:29.252053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 92/187] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:29 2022] GET /identity/v3/role_assignments?user.id=f3095d000b9e4c71ac3c8d00210c3718&scope.project.id=79e59a483c074c5d9aa1043296f81b5a&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:29.253387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.305296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 96/188] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:29.306639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816a86-9d23-46c8-b107-25fb39a484f3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.398910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cceaab-2f49-42e5-be96-dff0efa76887 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.420121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:29.442628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816a86-9d23-46c8-b107-25fb39a484f3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.446409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.447194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.447478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.447751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.448984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:29.450557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:29.452669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 93/189] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:29.453300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.482576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:29.492945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.493747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.494025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.494295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] PATH_INFO: `/v3/users/1a833b9d2b774de48345e36ca94e9d32` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.513628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=1a833b9d2b774de48345e36ca94e9d32)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:29.515466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:29.517059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 97/190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:29 2022] GET /identity/v3/users/1a833b9d2b774de48345e36ca94e9d32 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:29.517726 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.587305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5650b0c-5254-4910-888d-9863b128d4bc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.621853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.622385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34f607-4fed-42d7-8bb0-b0b817057ac5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.622656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.622935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.623207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.633361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:29.641392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:29.642350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:29.643201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 94/191] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:29.643863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.660533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1122c-3029-49aa-9058-d8a73bdd76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.661204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1122c-3029-49aa-9058-d8a73bdd76b0 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.661492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1122c-3029-49aa-9058-d8a73bdd76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.661773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1122c-3029-49aa-9058-d8a73bdd76b0 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.662486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1122c-3029-49aa-9058-d8a73bdd76b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:29.663931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1122c-3029-49aa-9058-d8a73bdd76b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:29.672305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:29.730691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:29.746518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae902a-4930-4cbf-91c0-3d85266851f7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.778808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.779453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.779737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.780015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.793013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 98/192] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:58:29 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:29.796521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731517-1446-4988-9858-fc3eb2e7686f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.796521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731517-1446-4988-9858-fc3eb2e7686f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.796521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731517-1446-4988-9858-fc3eb2e7686f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.796521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 99/193] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:29.796987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67731517-1446-4988-9858-fc3eb2e7686f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:29.864182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:29.866171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:29.912969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67731517-1446-4988-9858-fc3eb2e7686f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:29.952057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e263e1-6fcd-4e7a-8f50-021aaff53b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:29.952800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e263e1-6fcd-4e7a-8f50-021aaff53b10 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.953082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e263e1-6fcd-4e7a-8f50-021aaff53b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.953360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e263e1-6fcd-4e7a-8f50-021aaff53b10 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.954121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e263e1-6fcd-4e7a-8f50-021aaff53b10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:29.954425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e263e1-6fcd-4e7a-8f50-021aaff53b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:29.956433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e263e1-6fcd-4e7a-8f50-021aaff53b10 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:29.966961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 100/194] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:29.969105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f89e-ec6f-4bbc-9e59-4a08a88eee62 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:29.969422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f89e-ec6f-4bbc-9e59-4a08a88eee62 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:29.969700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f89e-ec6f-4bbc-9e59-4a08a88eee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:29.977122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:29.988121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3604f89e-ec6f-4bbc-9e59-4a08a88eee62 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:29.989357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3604f89e-ec6f-4bbc-9e59-4a08a88eee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:29.998665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 95/195] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:29.999444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.056845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:30.071650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 101/196] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:30.072546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604f89e-ec6f-4bbc-9e59-4a08a88eee62 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.119889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4bd34-d55e-49e2-8de4-ee768fae5a68 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.163552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.164812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.165089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] PATH_INFO: `/v3/users/1a833b9d2b774de48345e36ca94e9d32` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.166339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] RBAC: Authorizing `identity:get_user(user_id=1a833b9d2b774de48345e36ca94e9d32)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:30.167778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:30.170378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 96/197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:29 2022] GET /identity/v3/users/1a833b9d2b774de48345e36ca94e9d32 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:30.171063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.204034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604f89e-ec6f-4bbc-9e59-4a08a88eee62 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.245673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:30.249829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.251222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.251857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.253191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.255154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:30.257500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:30.259691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 102/198] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:30.264369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.308477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c3dc9-c105-4636-ae1e-697e51463498 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.339812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:30.353791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.354595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.354877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.355152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.366222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:30.375492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:30.376434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:30.377799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 97/199] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:30.379374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.404480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec77114-0d93-42d8-a072-ff8f54ac5fdd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.452700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.453713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.454193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.454665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.511470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca08684-7d15-4021-ae04-c1378799bcc5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.529278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:30.529713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:30.531195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:30.559429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.560886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.561552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.562086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.563233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=1a833b9d2b774de48345e36ca94e9d32) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:30.563695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:30.566563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:30.573704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 98/200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/role_assignments?user.id=1a833b9d2b774de48345e36ca94e9d32&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:30.574789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.613198 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:30.702831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a803271-f280-4510-a4bc-88489d26394f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.717530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 103/201] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:30.729321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.744005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.745314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.745743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.746260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.747207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:30.747667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:30.749246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:30.759314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 99/202] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:30.777382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.834355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:30.855176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6903-ef03-4455-bd02-cc9714a9100d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.906223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.909635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.912898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.913425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.915968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:30.919876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:30.926034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 104/203] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:30.929070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:30.931995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9b066-a568-44c0-8c4a-bf4fa1c9af9f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:30.974668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:30.975926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:30.976448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:30.977073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] PATH_INFO: `/v3/users/d439e3cf2904415e9f0433807c9d0901` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:30.978484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] RBAC: Authorizing `identity:get_user(user_id=d439e3cf2904415e9f0433807c9d0901)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:30.980123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:30.982060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 100/204] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/users/d439e3cf2904415e9f0433807c9d0901 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:30.988168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:30.992726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:31.087294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372316-6151-443e-b0dd-36d6a86ca835 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:31.150575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:31.151229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:31.151505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:31.151778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:31.152632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] RBAC: Adding query filter params (role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=1a833b9d2b774de48345e36ca94e9d32) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:31.152941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:31.154368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:31.163754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 105/205] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/role_assignments?user.id=1a833b9d2b774de48345e36ca94e9d32&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:31.178479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115cbbd-487e-4d7e-8476-45f4d17071cb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:31.194898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:31.221602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:31.222606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:31.222917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:31.223191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:31.312277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:31.313805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:31.462857 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 101/206] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:58:31.468361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:31.622193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:31.638413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26d0c-143f-4311-9d00-e31db0e41529 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:31.675010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5bd10-910f-4475-8fb9-49cb7df49d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:31.675875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5bd10-910f-4475-8fb9-49cb7df49d8c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:31.676159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5bd10-910f-4475-8fb9-49cb7df49d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:31.676468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5bd10-910f-4475-8fb9-49cb7df49d8c None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:31.677686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5bd10-910f-4475-8fb9-49cb7df49d8c None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:31.679135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5bd10-910f-4475-8fb9-49cb7df49d8c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:31.681416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 106/207] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:31 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:31.687211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:31.696121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:31.809345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1051ac-af9f-4069-9f3a-ec8e798c08ef None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:31.855976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9baf7-5bfc-4f3e-be8f-cddd5feb680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:31.856818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9baf7-5bfc-4f3e-be8f-cddd5feb680e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:31.857107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9baf7-5bfc-4f3e-be8f-cddd5feb680e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:31.857383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9baf7-5bfc-4f3e-be8f-cddd5feb680e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:31.858215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9baf7-5bfc-4f3e-be8f-cddd5feb680e None admin] RBAC: Adding query filter params (role.id=7dabad7a1cff40a59c9820e02e0de925, scope.project.id=12617164ba504ce18054575cb49f5cd5, user.id=d439e3cf2904415e9f0433807c9d0901) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:31.858526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9baf7-5bfc-4f3e-be8f-cddd5feb680e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:31.859979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9baf7-5bfc-4f3e-be8f-cddd5feb680e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:31.868733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 102/208] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:31 2022] GET /identity/v3/role_assignments?user.id=d439e3cf2904415e9f0433807c9d0901&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=7dabad7a1cff40a59c9820e02e0de925 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:32.227068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a5c4b-4e1d-4ba1-b4a3-bbdfd7a55b22 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.227569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a5c4b-4e1d-4ba1-b4a3-bbdfd7a55b22 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.227569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a5c4b-4e1d-4ba1-b4a3-bbdfd7a55b22 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.229259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 107/209] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:32.235273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6400d0-78c7-43ae-93ad-72d93fa6b423 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.235566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6400d0-78c7-43ae-93ad-72d93fa6b423 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.235847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6400d0-78c7-43ae-93ad-72d93fa6b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.253119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ef6400d0-78c7-43ae-93ad-72d93fa6b423 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:32.254273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ef6400d0-78c7-43ae-93ad-72d93fa6b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:32.324021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:32.328422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 103/210] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:32.356150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a5c4b-4e1d-4ba1-b4a3-bbdfd7a55b22 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:32.358252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88444-14e7-45ba-8a01-67f16a08cf5a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.358501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88444-14e7-45ba-8a01-67f16a08cf5a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.358779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88444-14e7-45ba-8a01-67f16a08cf5a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.360170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 104/211] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:32.366099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51e975-d42e-47b5-99c6-3b9053e744fb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.366381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51e975-d42e-47b5-99c6-3b9053e744fb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.366658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51e975-d42e-47b5-99c6-3b9053e744fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.388950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3f51e975-d42e-47b5-99c6-3b9053e744fb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:32.390138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3f51e975-d42e-47b5-99c6-3b9053e744fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:32.472389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 105/212] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:32.489512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a5c4b-4e1d-4ba1-b4a3-bbdfd7a55b22 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:32.490564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51e975-d42e-47b5-99c6-3b9053e744fb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:32.524884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:32.525681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.525962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.526233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.527415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:32.528897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:32.530882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 108/213] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:32.537125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:32.572625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:32.623160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51e975-d42e-47b5-99c6-3b9053e744fb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:32.654536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:32.660872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:32.661888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.662359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.662797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.666177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e835-b6b3-404c-b01d-051afb3c4179 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:32.674084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:32.682364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:32.683257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:32.684108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:32.692061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 106/214] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:32.693185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:32.707900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:32.708666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.708976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.709257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.710291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:32.712620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:32.801041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12f949-fc09-4cd2-8d4d-d30383d9b28c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:32.819230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 109/215] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:58:32 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:58:32.842690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:32.844212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:32.844853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:32.845309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:32.847069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:32.847590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:32.849339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:32.861236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 107/216] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:32.871799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:32.983089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:32.990425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3c820-0318-4951-acec-740149d9ae8c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:33.026999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55457-3151-43e2-9832-dcb5214a11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:33.028010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55457-3151-43e2-9832-dcb5214a11a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.028406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55457-3151-43e2-9832-dcb5214a11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.028748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55457-3151-43e2-9832-dcb5214a11a6 None admin] PATH_INFO: `/v3/users/6837368a0ef84aaa9a2103c2bf508141` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.043994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab55457-3151-43e2-9832-dcb5214a11a6 None admin] RBAC: Authorizing `identity:get_user(user_id=6837368a0ef84aaa9a2103c2bf508141)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:33.045522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab55457-3151-43e2-9832-dcb5214a11a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:33.047603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 110/217] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:32 2022] GET /identity/v3/users/6837368a0ef84aaa9a2103c2bf508141 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:33.054052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:33.116554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:33.179497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dfdbe-29a4-43de-b627-4f5050e2d153 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:33.218861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:33.219498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.219785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.220064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.222400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3eed8-59c0-4097-9f19-eaf637199ccd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.222924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3eed8-59c0-4097-9f19-eaf637199ccd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.223404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3eed8-59c0-4097-9f19-eaf637199ccd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.227453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 111/218] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:33.232928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b944-bc0c-4a46-8017-ed64320142da None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.233349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b944-bc0c-4a46-8017-ed64320142da None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.233733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b944-bc0c-4a46-8017-ed64320142da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.254684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5ff0b944-bc0c-4a46-8017-ed64320142da None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:33.255880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ff0b944-bc0c-4a46-8017-ed64320142da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:33.304470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:33.306196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:33.378814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 112/219] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:33.379279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:33.413753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b944-bc0c-4a46-8017-ed64320142da None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:33.431258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 108/220] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:33.437504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:33.507518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:33.558245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b944-bc0c-4a46-8017-ed64320142da None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:33.578828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090648-aa4b-4314-8f89-7a7abe88b70a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:33.601928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:33.602984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.603404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.603815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.615771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:33.621544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9f739-9248-423e-82a6-66cf01b4fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:33.622401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9f739-9248-423e-82a6-66cf01b4fe22 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.622680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9f739-9248-423e-82a6-66cf01b4fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.622955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9f739-9248-423e-82a6-66cf01b4fe22 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.624161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9f739-9248-423e-82a6-66cf01b4fe22 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:33.624308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:33.625347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:33.626309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:33.626917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9f739-9248-423e-82a6-66cf01b4fe22 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:33.628482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 109/221] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:33 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:33.629436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2247d-2a39-43c0-8b95-2a99d91c8255 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.629720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2247d-2a39-43c0-8b95-2a99d91c8255 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.630077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2247d-2a39-43c0-8b95-2a99d91c8255 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.630456 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 113/222] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:33.631361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 110/223] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:33.636906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:33.637256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335970b-426b-4789-993e-a2b01ce127a9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.637555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335970b-426b-4789-993e-a2b01ce127a9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.637907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335970b-426b-4789-993e-a2b01ce127a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.655260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c335970b-426b-4789-993e-a2b01ce127a9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:33.656681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c335970b-426b-4789-993e-a2b01ce127a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:33.672389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:33.736222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 111/224] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:33.736222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335970b-426b-4789-993e-a2b01ce127a9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:33.771454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671c67-f22c-45fb-82d3-37fcefafb259 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:33.798930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:33.816096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:33.816096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.816096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.816096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.816474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=6837368a0ef84aaa9a2103c2bf508141) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:33.816474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:33.816474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:33.819789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 114/225] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:33 2022] GET /identity/v3/role_assignments?user.id=6837368a0ef84aaa9a2103c2bf508141&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:33.820684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:33.858821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335970b-426b-4789-993e-a2b01ce127a9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:33.898709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:33.899778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.900311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.900780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.901734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:33.902230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:33.903793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:33.913478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 112/226] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:33.919084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:33.932073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da38814-0441-4652-ac0c-e98ae886338b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:33.937540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:33.969705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:33.970922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:33.971467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:33.971942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:33.983795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:33.992318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:33.993256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:33.994069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:33.996580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 115/227] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:34.006444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:34.067467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c4fe-6c07-41d4-8be8-fdc48efcc979 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:34.094249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:34.107262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:34.122549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:34.122549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:34.122549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] PATH_INFO: `/v3/users/1a833b9d2b774de48345e36ca94e9d32` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:34.122549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] RBAC: Authorizing `identity:get_user(user_id=1a833b9d2b774de48345e36ca94e9d32)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:34.122549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:34.122549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 113/228] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:33 2022] GET /identity/v3/users/1a833b9d2b774de48345e36ca94e9d32 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:34.123033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:34.168539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdff157-e1de-4a77-a464-b29a588c7d03 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:34.203830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:34.204838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:34.205369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:34.205811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:34.206885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:34.207335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:34.208945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:34.212550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:34.217989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 116/229] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:34.225875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:34.245254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9d1d-7d8a-4398-84e9-17b326126f4e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:34.304992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:34.305859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:34.306143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:34.306422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:34.307657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:34.309165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:34.311250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 114/230] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:34 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:34.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:34.487068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669c596-9660-4270-9ef7-4450c8aa94c2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:34.531902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef80a58-8dcf-4e01-9ee6-201964e1e26f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:34.540534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:34.573138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:34.574018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:34.574298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:34.574575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] PATH_INFO: `/v3/users/1a833b9d2b774de48345e36ca94e9d32` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:34.575777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] RBAC: Authorizing `identity:get_user(user_id=1a833b9d2b774de48345e36ca94e9d32)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:34.577268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:34.579033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 117/231] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:34 2022] GET /identity/v3/users/1a833b9d2b774de48345e36ca94e9d32 => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:34.583048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:34.584031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:34.584623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:34.584823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/1a833b9d2b774de48345e36ca94e9d32/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:34.591779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:34.591914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d23a9abfe764ab4912e967737d8cbd9, user_id=1a833b9d2b774de48345e36ca94e9d32, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:34.591914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:34.668154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 115/232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:34 2022] PUT /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/1a833b9d2b774de48345e36ca94e9d32/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:58:34.711884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a9d1-be6a-448c-b08a-6810c03b3f10 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:34.751446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055b7c9-34f5-4ffc-9909-0599e5f2cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:34.752819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b7c9-34f5-4ffc-9909-0599e5f2cb4a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:34.753378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b7c9-34f5-4ffc-9909-0599e5f2cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:34.754098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b7c9-34f5-4ffc-9909-0599e5f2cb4a None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:34.755417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055b7c9-34f5-4ffc-9909-0599e5f2cb4a None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:34.756914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055b7c9-34f5-4ffc-9909-0599e5f2cb4a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:34.759022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 118/233] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:34 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:34.764984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:34.781764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:34.909122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb6f7a-f723-404d-bdef-4772fb033420 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:34.948602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd28535-f4d7-44b7-aa34-3b7fb93148e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:34.949492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd28535-f4d7-44b7-aa34-3b7fb93148e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:34.949774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd28535-f4d7-44b7-aa34-3b7fb93148e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:34.950045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd28535-f4d7-44b7-aa34-3b7fb93148e7 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/1a833b9d2b774de48345e36ca94e9d32/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:34.952307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd28535-f4d7-44b7-aa34-3b7fb93148e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d23a9abfe764ab4912e967737d8cbd9, user_id=1a833b9d2b774de48345e36ca94e9d32, role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:34.953760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd28535-f4d7-44b7-aa34-3b7fb93148e7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:35.079590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 116/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:34 2022] PUT /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/1a833b9d2b774de48345e36ca94e9d32/roles/d8548213eacf423fb6e7c5832be20d3b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:35.494555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0541-8512-44a4-85d6-58d0d93611ee None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:35.495043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0541-8512-44a4-85d6-58d0d93611ee None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:35.495043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0541-8512-44a4-85d6-58d0d93611ee None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:35.496505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 119/235] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:35.501642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd020-8534-4599-bb9b-e597489f1ad5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:35.501931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd020-8534-4599-bb9b-e597489f1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:35.502204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd020-8534-4599-bb9b-e597489f1ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:35.527953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-41bdd020-8534-4599-bb9b-e597489f1ad5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:35.529264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-41bdd020-8534-4599-bb9b-e597489f1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:35.560151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18d7e-4b82-46fb-a2ed-bd0c20052541 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:35.560497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18d7e-4b82-46fb-a2ed-bd0c20052541 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:35.560728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18d7e-4b82-46fb-a2ed-bd0c20052541 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:35.562365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 120/236] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:35.569733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3701102-9610-4d97-902e-9923020909eb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:35.570017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3701102-9610-4d97-902e-9923020909eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:35.570300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3701102-9610-4d97-902e-9923020909eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:35.603867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a3701102-9610-4d97-902e-9923020909eb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:35.605415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3701102-9610-4d97-902e-9923020909eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:35.623311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:35.630841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 117/237] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:35.667971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd020-8534-4599-bb9b-e597489f1ad5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:35.724550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:35.783282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd020-8534-4599-bb9b-e597489f1ad5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:35.786215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:35.840906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:35.841706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:35.841985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:35.842255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:35.843510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:35.844966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:35.847558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 118/239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:35.850622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3701102-9610-4d97-902e-9923020909eb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:35.856894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:35.931498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:35.970954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939b6cb-f310-42f5-bf0f-f99919496fe1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:36.021706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:36.022386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.022663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.022932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.023651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:36.025102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:36.070328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3701102-9610-4d97-902e-9923020909eb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:36.106458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:36.110719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.114681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 119/240] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:58:35 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:58:36.114804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.115052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.128047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:36.136130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:36.137063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:36.137864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 122/241] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:36.143897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:36.266589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2685bf-95ea-4737-ad64-f92b1e6e891a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:36.294535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:36.307204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af6bfa-bc26-4e6f-90f8-ebbdc588af66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:36.307883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6bfa-bc26-4e6f-90f8-ebbdc588af66 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.308178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6bfa-bc26-4e6f-90f8-ebbdc588af66 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.308486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6bfa-bc26-4e6f-90f8-ebbdc588af66 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.309254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af6bfa-bc26-4e6f-90f8-ebbdc588af66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:36.309565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af6bfa-bc26-4e6f-90f8-ebbdc588af66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:36.311008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af6bfa-bc26-4e6f-90f8-ebbdc588af66 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:36.321785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 120/242] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:36.327151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:36.352854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206ef6-96a5-413b-9abf-4590755de6bc None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.353160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206ef6-96a5-413b-9abf-4590755de6bc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.353410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206ef6-96a5-413b-9abf-4590755de6bc None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.355750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 121/243] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:36.361434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7dbac-576d-4327-ab9b-80cbe2f0f692 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.361915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7dbac-576d-4327-ab9b-80cbe2f0f692 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.362736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7dbac-576d-4327-ab9b-80cbe2f0f692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.380907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:36.386939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dfc7dbac-576d-4327-ab9b-80cbe2f0f692 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:36.388897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dfc7dbac-576d-4327-ab9b-80cbe2f0f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:36.457219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002e158-2edf-4f77-8e0f-70a1bb8d7f8d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:36.467075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 122/244] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:36.492250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7dbac-576d-4327-ab9b-80cbe2f0f692 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:36.499696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:36.500603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.500884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.501156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] PATH_INFO: `/v3/users/99b6e24a29214c0584820416dbe29eb9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.524104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] RBAC: Authorizing `identity:get_user(user_id=99b6e24a29214c0584820416dbe29eb9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:36.524431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:36.526470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 123/245] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:36 2022] GET /identity/v3/users/99b6e24a29214c0584820416dbe29eb9 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:36.532338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:36.626250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7dbac-576d-4327-ab9b-80cbe2f0f692 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:36.652525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:36.654231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:36.664771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c77888-1782-4041-be90-79d53c536a33 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:36.679595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:36.680516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.680804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.681080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.696890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:36.708103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:36.708307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:36.709155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:36.709953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 123/246] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:36.711888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.716469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.717041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.721112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:36.822990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:36.825096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:36.870009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abc55f-66d8-4f50-9858-ea809c07ceb6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:36.907781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:36.909109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:36.909777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:36.909777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:36.910508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:36.910823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:36.912234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:36.922264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 124/247] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:36.934277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:36.958807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:36.966472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 124/248] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:36.972969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:37.020547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:37.089738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58ecd0-d1df-4562-a6cd-368f3c76d01e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:37.128950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:37.129994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.130352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.130700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:37.131986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:37.134143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:37.136633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 125/249] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:36 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:37.142485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760012-5a85-4a38-bc57-cb9359e52a2a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:37.145277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:37.203325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813704e-04b1-44e5-892e-d3c5255717ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:37.204224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813704e-04b1-44e5-892e-d3c5255717ed None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.204546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813704e-04b1-44e5-892e-d3c5255717ed None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.204806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813704e-04b1-44e5-892e-d3c5255717ed None admin] PATH_INFO: `/v3/users/6837368a0ef84aaa9a2103c2bf508141` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:37.206362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813704e-04b1-44e5-892e-d3c5255717ed None admin] RBAC: Authorizing `identity:get_user(user_id=6837368a0ef84aaa9a2103c2bf508141)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:37.207807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813704e-04b1-44e5-892e-d3c5255717ed None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:37.209790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 125/250] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:36 2022] GET /identity/v3/users/6837368a0ef84aaa9a2103c2bf508141 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:37.211116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c906-58a0-4b9e-8b14-5aadb3df1ab0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.211401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c906-58a0-4b9e-8b14-5aadb3df1ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.211672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c906-58a0-4b9e-8b14-5aadb3df1ab0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:37.212979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 126/251] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:37.217833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c906-58a0-4b9e-8b14-5aadb3df1ab0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:37.244328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:37.310272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8e27-f43b-4d32-9e04-b4d08e9af30c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:37.381934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c67db8-394f-43e3-8f21-5f3c77b2612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:37.382521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c67db8-394f-43e3-8f21-5f3c77b2612f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.382802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c67db8-394f-43e3-8f21-5f3c77b2612f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.383073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c67db8-394f-43e3-8f21-5f3c77b2612f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:37.383913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c67db8-394f-43e3-8f21-5f3c77b2612f None admin] RBAC: Adding query filter params (role.id=7dabad7a1cff40a59c9820e02e0de925, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=99b6e24a29214c0584820416dbe29eb9) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:37.384239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c67db8-394f-43e3-8f21-5f3c77b2612f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:37.385693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c67db8-394f-43e3-8f21-5f3c77b2612f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:37.402315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 126/252] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:37 2022] GET /identity/v3/role_assignments?user.id=99b6e24a29214c0584820416dbe29eb9&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=7dabad7a1cff40a59c9820e02e0de925 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:37.403644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1f5e0-a5bd-46af-b997-637ef415a9ff None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.403919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1f5e0-a5bd-46af-b997-637ef415a9ff None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.404341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1f5e0-a5bd-46af-b997-637ef415a9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:37.434511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c906-58a0-4b9e-8b14-5aadb3df1ab0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:37.438963 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:37.453444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4dc1f5e0-a5bd-46af-b997-637ef415a9ff None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:37.454675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4dc1f5e0-a5bd-46af-b997-637ef415a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:37.553579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:37.554520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.554806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.555140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:37.556387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:37.557940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:37.559807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 127/253] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:37 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:37.567883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:37.641700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 127/254] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:37.714868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1f5e0-a5bd-46af-b997-637ef415a9ff None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:37.754530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2fe4-1b18-45f4-b8cb-36834dc197ca None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:37.829728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:37.831213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.831739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.831900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/6837368a0ef84aaa9a2103c2bf508141/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:37.834051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d23a9abfe764ab4912e967737d8cbd9, user_id=6837368a0ef84aaa9a2103c2bf508141, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:37.835550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:37.837888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:37.930813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 128/255] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:37 2022] PUT /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/6837368a0ef84aaa9a2103c2bf508141/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:37.935702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1f5e0-a5bd-46af-b997-637ef415a9ff None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:37.988322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:37.989236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:37.989517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:37.989791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:38.006419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:38.014249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:38.015147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:38.015963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 128/256] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:38.021807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:38.073970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:38.162802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cb3f0-9853-4457-b196-5275c142b906 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:38.201753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fa780-25bd-44ce-bde4-1a0d45fea78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:38.202350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fa780-25bd-44ce-bde4-1a0d45fea78f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:38.202627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fa780-25bd-44ce-bde4-1a0d45fea78f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:38.202900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fa780-25bd-44ce-bde4-1a0d45fea78f None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:38.203653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fa780-25bd-44ce-bde4-1a0d45fea78f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:38.203953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fa780-25bd-44ce-bde4-1a0d45fea78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:38.205391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fa780-25bd-44ce-bde4-1a0d45fea78f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:38.221056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 129/257] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:38.226961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:38.282595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906028b3-1f2c-432f-906c-3fbc896bd3f4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:38.282919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906028b3-1f2c-432f-906c-3fbc896bd3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:38.283145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906028b3-1f2c-432f-906c-3fbc896bd3f4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:38.284631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 130/258] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:38.294145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e6d23-fe4d-47a5-86e6-9c250cd1ee84 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:38.294446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e6d23-fe4d-47a5-86e6-9c250cd1ee84 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:38.294702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e6d23-fe4d-47a5-86e6-9c250cd1ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:38.329231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-329e6d23-fe4d-47a5-86e6-9c250cd1ee84 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:38.330458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-329e6d23-fe4d-47a5-86e6-9c250cd1ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:38.363638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0ecc8-192e-4a1f-ba76-08fcdf5f6832 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:38.385978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:38.411686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:38.412597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:38.412879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:38.413152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] PATH_INFO: `/v3/users/1a833b9d2b774de48345e36ca94e9d32` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:38.416966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] RBAC: Authorizing `identity:get_user(user_id=1a833b9d2b774de48345e36ca94e9d32)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:38.418386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:38.420034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 129/259] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:38 2022] GET /identity/v3/users/1a833b9d2b774de48345e36ca94e9d32 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:38.426060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:38.542452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 131/260] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:38.589359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba896445-f72d-4c6b-b29c-2fdff35b9c40 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:38.593628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e6d23-fe4d-47a5-86e6-9c250cd1ee84 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:38.657879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:38.659769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:38.660371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:38.660845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:38.661307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:38.781611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:38.816451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:38.817846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:38.842355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e6d23-fe4d-47a5-86e6-9c250cd1ee84 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:38.937465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:38.938292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:38.938570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:38.938844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:38.973145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:38.983802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 130/261] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:38.985286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:38.986246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:38.987276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 132/262] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:38.993904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:38.994034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:39.180735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:39.197501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:39.218792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a892485-ecfc-41b6-9010-b1cafbaf2dc5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:39.230427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912f0d-d492-423b-a4c2-8391e1911cd0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:39.293538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:39.294761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.295422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.295913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.297341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:39.298972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:39.301789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 131/263] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:38 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:39.307496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:39.325864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:39.326536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.326814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.327092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.327850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:39.328157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:39.329570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:39.347649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 133/264] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:39.355369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:39.494466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346d297-25b1-4488-bf99-d16c9ba88c43 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:39.554542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e8b44-beda-4705-87ee-72551b1c456a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:39.587624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a438300-3507-4578-9eb5-22f717db921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:39.588602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a438300-3507-4578-9eb5-22f717db921b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.588713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a438300-3507-4578-9eb5-22f717db921b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.588945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a438300-3507-4578-9eb5-22f717db921b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.589785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a438300-3507-4578-9eb5-22f717db921b None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=1a833b9d2b774de48345e36ca94e9d32) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:39.590092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a438300-3507-4578-9eb5-22f717db921b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:39.591544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a438300-3507-4578-9eb5-22f717db921b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:39.604105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313db524-c418-4af5-9b26-77070f8612de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:39.605115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313db524-c418-4af5-9b26-77070f8612de None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.605404 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313db524-c418-4af5-9b26-77070f8612de None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.605681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313db524-c418-4af5-9b26-77070f8612de None admin] PATH_INFO: `/v3/users/1a833b9d2b774de48345e36ca94e9d32` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.606134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 132/265] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:39 2022] GET /identity/v3/role_assignments?user.id=1a833b9d2b774de48345e36ca94e9d32&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:39.606973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313db524-c418-4af5-9b26-77070f8612de None admin] RBAC: Authorizing `identity:get_user(user_id=1a833b9d2b774de48345e36ca94e9d32)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:39.607441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e409f8f-1160-455b-ac07-f2a2b611fde2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.607723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e409f8f-1160-455b-ac07-f2a2b611fde2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.607998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e409f8f-1160-455b-ac07-f2a2b611fde2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.608466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313db524-c418-4af5-9b26-77070f8612de None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:39.610491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 134/266] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:39 2022] GET /identity/v3/users/1a833b9d2b774de48345e36ca94e9d32 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:39.612333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8c22-016f-4b48-8788-d97da6b02c80 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.612727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8c22-016f-4b48-8788-d97da6b02c80 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.613014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8c22-016f-4b48-8788-d97da6b02c80 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.613938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 133/267] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:39.614553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 135/268] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:39.619439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ee78-342b-4c68-9a16-4b62cfc6b88b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.619728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ee78-342b-4c68-9a16-4b62cfc6b88b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.620006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ee78-342b-4c68-9a16-4b62cfc6b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.620103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d109-c498-4ae6-b9ab-1bd077cee6cc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.620367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d109-c498-4ae6-b9ab-1bd077cee6cc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.620651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d109-c498-4ae6-b9ab-1bd077cee6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.657922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e561ee78-342b-4c68-9a16-4b62cfc6b88b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:39.659226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e561ee78-342b-4c68-9a16-4b62cfc6b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:39.662473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b064d109-c498-4ae6-b9ab-1bd077cee6cc None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:39.663672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b064d109-c498-4ae6-b9ab-1bd077cee6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:39.684016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:39.693935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:39.764350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 136/269] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:39.765392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064d109-c498-4ae6-b9ab-1bd077cee6cc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:39.806773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 134/270] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:39.819746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ee78-342b-4c68-9a16-4b62cfc6b88b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:39.902104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064d109-c498-4ae6-b9ab-1bd077cee6cc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:39.944767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ee78-342b-4c68-9a16-4b62cfc6b88b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:39.947839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:39.948532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.948815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.949088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.966069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:39.982961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:39.984103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:39.984666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:39.984943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:39.986205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:39.989123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:39.991338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 135/271] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:39.992289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.025417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:40.040737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:40.042381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:40.132817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0c3a-7bfc-46d3-aed6-2d079e9bff8d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.161147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 137/272] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:40.161964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.175166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6258b-1681-454e-9bcf-d61f4cb58685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.176075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6258b-1681-454e-9bcf-d61f4cb58685 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.176253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6258b-1681-454e-9bcf-d61f4cb58685 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.176525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6258b-1681-454e-9bcf-d61f4cb58685 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.187856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6258b-1681-454e-9bcf-d61f4cb58685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-91e6258b-1681-454e-9bcf-d61f4cb58685 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:40.195668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:40.196621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:40.197439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 136/273] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:40.198100 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc86330-ef93-4132-9e67-de350f477952 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.198911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc86330-ef93-4132-9e67-de350f477952 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.198911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc86330-ef93-4132-9e67-de350f477952 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.203971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 137/274] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:40.203971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc86330-ef93-4132-9e67-de350f477952 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.219969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:40.283299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561ff57-c6ec-4d22-9e93-8c1b9defb168 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.287735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:40.312324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc86330-ef93-4132-9e67-de350f477952 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.321034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7988db7-7819-4ab0-9397-708184678386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.321908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988db7-7819-4ab0-9397-708184678386 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.322188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988db7-7819-4ab0-9397-708184678386 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.322472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988db7-7819-4ab0-9397-708184678386 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.323183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7988db7-7819-4ab0-9397-708184678386 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:40.324658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7988db7-7819-4ab0-9397-708184678386 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:40.348546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.349403 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.349680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.349951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.351110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:40.352675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:40.354376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 138/275] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:40 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:40.355130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.405568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 138/276] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:58:40 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:40.406997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cafd-b95f-4ce5-8320-29579ebed6a6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.407588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cafd-b95f-4ce5-8320-29579ebed6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.407923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cafd-b95f-4ce5-8320-29579ebed6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.441001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b1f5cafd-b95f-4ce5-8320-29579ebed6a6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:40.443697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b1f5cafd-b95f-4ce5-8320-29579ebed6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:40.473944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f2433-4a1a-4b6e-8e76-25b649b1f5fe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.514105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.515304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.515845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.516476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.517423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:40.518576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:40.520724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:40.535955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 139/277] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:40.536952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.538677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 139/278] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:40.543898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5cafd-b95f-4ce5-8320-29579ebed6a6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.561777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:40.603146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:40.696280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5cafd-b95f-4ce5-8320-29579ebed6a6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.711841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba75f22-4e2e-4802-b0ad-2302828d2441 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.746105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.746980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.747261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.747539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] PATH_INFO: `/v3/users/051fbe0e6316486286cedd70a1a1d8be` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.756170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.756857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.757137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.757410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.758238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] RBAC: Adding query filter params (role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=1a833b9d2b774de48345e36ca94e9d32) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:40.758548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:40.759997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:40.763708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] RBAC: Authorizing `identity:get_user(user_id=051fbe0e6316486286cedd70a1a1d8be)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:40.765215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:40.767185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 140/279] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:40 2022] GET /identity/v3/users/051fbe0e6316486286cedd70a1a1d8be => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:40.767591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 140/280] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:40 2022] GET /identity/v3/role_assignments?user.id=1a833b9d2b774de48345e36ca94e9d32&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:40.769135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.774271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:40.865901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:40.884828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:40.899159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a153d-a20f-4de5-a98e-eb1b8c40f24d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.900911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0759-e5b7-42b4-b16c-c1db60a5f288 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:40.949613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904c2d-4aef-498b-b4d8-5b66722d0574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.950289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904c2d-4aef-498b-b4d8-5b66722d0574 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.950570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904c2d-4aef-498b-b4d8-5b66722d0574 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.950843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904c2d-4aef-498b-b4d8-5b66722d0574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.951695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904c2d-4aef-498b-b4d8-5b66722d0574 None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, user.id=051fbe0e6316486286cedd70a1a1d8be, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:40.952007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904c2d-4aef-498b-b4d8-5b66722d0574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:40.953652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904c2d-4aef-498b-b4d8-5b66722d0574 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:40.962666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:40.963486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.963769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.964048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.966405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 141/281] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 07:58:40 2022] GET /identity/v3/role_assignments?user.id=051fbe0e6316486286cedd70a1a1d8be&scope.system=all&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:40.967735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cdf0b-ea0c-462a-b9c1-c6611fca6f76 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.968018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cdf0b-ea0c-462a-b9c1-c6611fca6f76 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.968322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cdf0b-ea0c-462a-b9c1-c6611fca6f76 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.969739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 142/282] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:40.976451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78312-874b-47e2-a06e-fc9834c901f5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:40.976772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78312-874b-47e2-a06e-fc9834c901f5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:40.977011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78312-874b-47e2-a06e-fc9834c901f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:40.997344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:41.006272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:41.007242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:41.008036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 141/283] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:41.009261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6af78312-874b-47e2-a06e-fc9834c901f5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:41.010358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6af78312-874b-47e2-a06e-fc9834c901f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:41.016005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:41.167192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e321898-48f2-4a56-b95c-6cbcb639f981 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:41.182853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 143/284] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:41.207248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:41.208119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:41.208530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:41.208906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:41.209781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:41.210215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:41.211727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:41.218562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78312-874b-47e2-a06e-fc9834c901f5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:41.225157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 142/285] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:41.230432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:41.251616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:41.341839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:41.368709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a908c4b-008b-46c2-83db-cb5904c093ab None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:41.400718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78312-874b-47e2-a06e-fc9834c901f5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:41.442282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:41.443899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:41.444217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:41.444503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] PATH_INFO: `/v3/users/99b6e24a29214c0584820416dbe29eb9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:41.446308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] RBAC: Authorizing `identity:get_user(user_id=99b6e24a29214c0584820416dbe29eb9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:41.447749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:41.449430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 143/286] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:41 2022] GET /identity/v3/users/99b6e24a29214c0584820416dbe29eb9 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:41.454994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:41.467259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:41.468068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:41.468368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:41.468637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:41.486534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:41.494391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:41.495287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:41.496083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:41.503864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 144/287] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:41.509156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:41.587234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:41.629716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73085a-aa1a-447a-b3e5-9a71eb9a32df None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:41.695841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:41.696657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:41.696936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:41.697207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:41.698500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:41.699928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:41.702009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035dca0-b41e-46b1-8c4f-9d975f493d7d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:41.705108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 144/288] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:41 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:41.712187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:41.751067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:41.771541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:41.772221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:41.772505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:41.772779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:41.773522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:41.773824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:41.775190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:41.792991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 145/289] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:41.798894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:41.920067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a51e9-8a2a-4cfb-bfe4-633c588ca537 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:41.998094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:41.998910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:41.999190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:41.999466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/99b6e24a29214c0584820416dbe29eb9/roles/7dabad7a1cff40a59c9820e02e0de925` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:42.002058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117a8c-8860-4828-b8ad-849fc2389317 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:42.005352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d23a9abfe764ab4912e967737d8cbd9, user_id=99b6e24a29214c0584820416dbe29eb9, role_id=7dabad7a1cff40a59c9820e02e0de925)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:42.006800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:42.048819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:42.050370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:42.050566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:42.050840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] PATH_INFO: `/v3/users/6837368a0ef84aaa9a2103c2bf508141` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:42.052110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] RBAC: Authorizing `identity:get_user(user_id=6837368a0ef84aaa9a2103c2bf508141)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:42.053655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:42.055680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 146/290] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:41 2022] GET /identity/v3/users/6837368a0ef84aaa9a2103c2bf508141 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:42.060733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:42.092514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 145/291] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:58:41 2022] PUT /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/users/99b6e24a29214c0584820416dbe29eb9/roles/7dabad7a1cff40a59c9820e02e0de925 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:42.130362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:42.180561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21abf5-7b16-4fc5-958c-c14725ff4644 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:42.218407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:42.219144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:42.219425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:42.219756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:42.298324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:42.300513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:42.360387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:42.409986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 147/292] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:42.415619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:42.425919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:42.532986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc396ef-3089-4cf1-b14c-af1da7052c28 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:42.579096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a73b95-39bb-417d-90f3-21ba6983e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:42.579096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73b95-39bb-417d-90f3-21ba6983e339 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:42.579096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73b95-39bb-417d-90f3-21ba6983e339 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:42.579096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73b95-39bb-417d-90f3-21ba6983e339 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:42.585135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a73b95-39bb-417d-90f3-21ba6983e339 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:42.586613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a73b95-39bb-417d-90f3-21ba6983e339 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:42.588727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 146/293] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:42 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:42.597777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:42.728177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c3a4-32e2-4688-b928-98786875df42 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:42.762736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4643903-972c-416b-a057-6b8c686a01b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:42.763481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643903-972c-416b-a057-6b8c686a01b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:42.763662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643903-972c-416b-a057-6b8c686a01b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:42.763937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643903-972c-416b-a057-6b8c686a01b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:42.764794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643903-972c-416b-a057-6b8c686a01b0 None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=6837368a0ef84aaa9a2103c2bf508141) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:42.765107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643903-972c-416b-a057-6b8c686a01b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:42.766556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643903-972c-416b-a057-6b8c686a01b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:42.773537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 148/294] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:42 2022] GET /identity/v3/role_assignments?user.id=6837368a0ef84aaa9a2103c2bf508141&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:43.052666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf050e-18a5-4d83-b0eb-534182b68c15 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.053027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf050e-18a5-4d83-b0eb-534182b68c15 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.053223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf050e-18a5-4d83-b0eb-534182b68c15 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.054670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 147/295] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:43.060005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18ad3-efb8-4fd1-a8ce-6408cff8122c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.060319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18ad3-efb8-4fd1-a8ce-6408cff8122c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.060604 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18ad3-efb8-4fd1-a8ce-6408cff8122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.079960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0ec18ad3-efb8-4fd1-a8ce-6408cff8122c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:43.081850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ec18ad3-efb8-4fd1-a8ce-6408cff8122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:43.096676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:43.127941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c5c66-2369-468e-80af-872b5af723fa None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.128733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c5c66-2369-468e-80af-872b5af723fa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.128733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c5c66-2369-468e-80af-872b5af723fa None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.130296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 148/296] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:43.137322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec5b4e-f594-4401-9aee-b55992d1301a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.137897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec5b4e-f594-4401-9aee-b55992d1301a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.138390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec5b4e-f594-4401-9aee-b55992d1301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.163595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 149/297] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:43.164694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-aeec5b4e-f594-4401-9aee-b55992d1301a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:43.165905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aeec5b4e-f594-4401-9aee-b55992d1301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:43.187152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec18ad3-efb8-4fd1-a8ce-6408cff8122c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:43.258808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 149/298] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:43.284944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec5b4e-f594-4401-9aee-b55992d1301a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:43.288503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:43.297459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec18ad3-efb8-4fd1-a8ce-6408cff8122c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:43.334531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:43.335236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.335512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.335781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.336955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:43.338381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:43.340190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 150/299] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:43.346915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:43.370156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:43.395673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec5b4e-f594-4401-9aee-b55992d1301a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:43.434791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:43.436399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.436825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.437241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.449615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:43.458202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:43.459297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:43.460301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:43.461884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9275dc-00f6-45fb-ab6f-56f68f7fc37a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:43.467420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 150/300] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:43.468477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:43.498854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:43.499624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.499910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.500186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] PATH_INFO: `/v3/groups` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.501002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:43.503104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:43.538008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:43.581475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9220e28-1fcb-4cfe-bf60-531f860b639a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:43.582240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 151/301] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Jun 24 07:58:43 2022] POST /identity/v3/groups => generated 229 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:58:43.625482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a948d-f17e-47e5-b8ca-e7ca076d988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:43.626086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a948d-f17e-47e5-b8ca-e7ca076d988b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.626369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a948d-f17e-47e5-b8ca-e7ca076d988b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.626644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a948d-f17e-47e5-b8ca-e7ca076d988b None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.627973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a948d-f17e-47e5-b8ca-e7ca076d988b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:43.627973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a948d-f17e-47e5-b8ca-e7ca076d988b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:43.629859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a948d-f17e-47e5-b8ca-e7ca076d988b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:43.641510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 151/302] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:43.647745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:43.659959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2817e1-969e-4713-acf1-db1bcea4f478 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.659959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2817e1-969e-4713-acf1-db1bcea4f478 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.660378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2817e1-969e-4713-acf1-db1bcea4f478 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.661980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 152/303] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:43.667403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c71fa-f63a-4a61-8530-31a51bacc2fc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.667686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c71fa-f63a-4a61-8530-31a51bacc2fc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.667968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c71fa-f63a-4a61-8530-31a51bacc2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.686578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e55c71fa-f63a-4a61-8530-31a51bacc2fc None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:43.687787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e55c71fa-f63a-4a61-8530-31a51bacc2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:43.748480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:43.782062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 153/304] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:43.786230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae88fe-2dda-4c23-a2b5-08dd057f8b8c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:43.806383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c71fa-f63a-4a61-8530-31a51bacc2fc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:43.831728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:43.832900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.833255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.833870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] PATH_INFO: `/v3/users/e704c175e2d84422afc2e875b7346038` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.855667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] RBAC: Authorizing `identity:get_user(user_id=e704c175e2d84422afc2e875b7346038)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:43.857357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:43.859930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 152/305] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:43 2022] GET /identity/v3/users/e704c175e2d84422afc2e875b7346038 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:43.866188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:43.872802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:43.919737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c71fa-f63a-4a61-8530-31a51bacc2fc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:43.956786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:43.958031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:43.958513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:43.959000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:43.970019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:43.973828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9214e-d13a-466a-ba71-2ef620346169 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:43.979114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:43.979987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:43.980845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:43.983559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 154/306] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:43.989891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:44.023264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:44.024039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:44.024370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:44.024649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:44.025820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] RBAC: Adding query filter params (role.id=7dabad7a1cff40a59c9820e02e0de925, user.id=e704c175e2d84422afc2e875b7346038, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:44.026135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:44.028088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:44.030172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:44.042860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 153/307] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 07:58:43 2022] GET /identity/v3/role_assignments?user.id=e704c175e2d84422afc2e875b7346038&scope.system=all&role.id=7dabad7a1cff40a59c9820e02e0de925 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:44.122395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc8333-b572-4f5a-81f3-1833169cd753 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:44.142293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:44.162379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:44.163119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:44.163385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:44.163662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:44.164458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:44.164764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:44.166171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:44.177368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 155/308] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:44.182939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:44.293182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affb7b-729e-457f-9cc0-f1c99cd9914e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:44.328955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5145d78-3b74-4b57-a539-8075518a13f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:44.329866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145d78-3b74-4b57-a539-8075518a13f7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:44.330147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145d78-3b74-4b57-a539-8075518a13f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:44.330991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145d78-3b74-4b57-a539-8075518a13f7 None admin] PATH_INFO: `/v3/users/051fbe0e6316486286cedd70a1a1d8be` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:44.332797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5145d78-3b74-4b57-a539-8075518a13f7 None admin] RBAC: Authorizing `identity:get_user(user_id=051fbe0e6316486286cedd70a1a1d8be)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:44.334242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5145d78-3b74-4b57-a539-8075518a13f7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:44.336226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 154/309] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:44 2022] GET /identity/v3/users/051fbe0e6316486286cedd70a1a1d8be => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:44.341802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:44.452151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841737b7-02c8-44f3-b573-9fba2956eb85 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:44.487967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeeed9-66fe-4529-bc91-9969fcb8b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:44.488827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeeed9-66fe-4529-bc91-9969fcb8b41d None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:44.489109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeeed9-66fe-4529-bc91-9969fcb8b41d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:44.489388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeeed9-66fe-4529-bc91-9969fcb8b41d None admin] PATH_INFO: `/v3/system/users/051fbe0e6316486286cedd70a1a1d8be/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:44.490889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeeed9-66fe-4529-bc91-9969fcb8b41d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=051fbe0e6316486286cedd70a1a1d8be, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:44.492281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeeed9-66fe-4529-bc91-9969fcb8b41d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:44.583602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 156/310] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Jun 24 07:58:44 2022] PUT /identity/v3/system/users/051fbe0e6316486286cedd70a1a1d8be/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:44.627079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97b28b-9f0c-4d19-ae8d-23426f4e3be3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:44.628094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97b28b-9f0c-4d19-ae8d-23426f4e3be3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:44.628094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97b28b-9f0c-4d19-ae8d-23426f4e3be3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:44.629854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 155/311] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:44.635550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a87da-a1bf-4247-aa72-8ba78f394b5f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:44.635891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a87da-a1bf-4247-aa72-8ba78f394b5f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:44.636181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a87da-a1bf-4247-aa72-8ba78f394b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:44.655049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d76a87da-a1bf-4247-aa72-8ba78f394b5f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:44.656508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d76a87da-a1bf-4247-aa72-8ba78f394b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:44.697264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:44.733088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 157/312] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:44.757575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97b28b-9f0c-4d19-ae8d-23426f4e3be3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:44.834664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:44.872234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97b28b-9f0c-4d19-ae8d-23426f4e3be3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:44.908811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:44.909616 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:44.909898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:44.910226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:44.920918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:44.929317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:44.930395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:44.931402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 156/313] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:44.937920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a87da-a1bf-4247-aa72-8ba78f394b5f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:45.039422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a87da-a1bf-4247-aa72-8ba78f394b5f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:45.074547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:45.075220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:45.075503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:45.075779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:45.076556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:45.076863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:45.078224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:45.087031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 158/314] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:45.092369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:45.196172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d91e-e09c-449f-a2a8-9423e48b6399 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:45.230747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:45.235353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:45.236711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:45.238188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:45.238693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] PATH_INFO: `/v3/users/99b6e24a29214c0584820416dbe29eb9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:45.240570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] RBAC: Authorizing `identity:get_user(user_id=99b6e24a29214c0584820416dbe29eb9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:45.242347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:45.244506 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 157/315] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:45 2022] GET /identity/v3/users/99b6e24a29214c0584820416dbe29eb9 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:45.253837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:45.291647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:45.363623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdc66c-a985-4655-806a-b04fdff25e99 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:45.399877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:45.400571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:45.400859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:45.401138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:45.473928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:45.475630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:45.510132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:45.581282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 159/316] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:45.588001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:45.694407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4450d40-4cac-4846-bc79-d200930ca5d9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:45.733723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856424a9-c2c0-45b9-86e3-a89d7d25e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:45.734589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856424a9-c2c0-45b9-86e3-a89d7d25e35a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:45.734875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856424a9-c2c0-45b9-86e3-a89d7d25e35a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:45.735146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856424a9-c2c0-45b9-86e3-a89d7d25e35a None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:45.736385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856424a9-c2c0-45b9-86e3-a89d7d25e35a None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:45.738654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856424a9-c2c0-45b9-86e3-a89d7d25e35a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:45.740780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 158/317] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:45 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:45.746533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:45.859150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b671-e5f6-471e-b2aa-ad3737e0ded1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:45.868758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b5e4e-30dc-43e5-8a82-7da5cf3e9c15 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:45.869293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b5e4e-30dc-43e5-8a82-7da5cf3e9c15 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:45.869509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b5e4e-30dc-43e5-8a82-7da5cf3e9c15 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:45.887447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 159/318] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:45 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:45.894218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3e167-6ad9-4f44-8ee3-be41ce48a74a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:45.894595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3e167-6ad9-4f44-8ee3-be41ce48a74a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:45.894895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3e167-6ad9-4f44-8ee3-be41ce48a74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:45.905542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:45.906481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:45.906956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:45.907420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:45.916716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] RBAC: Adding query filter params (role.id=7dabad7a1cff40a59c9820e02e0de925, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9, user.id=99b6e24a29214c0584820416dbe29eb9) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:45.917326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:45.919001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:45.923856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:45.927173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 160/319] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:58:45 2022] GET /identity/v3/role_assignments?user.id=99b6e24a29214c0584820416dbe29eb9&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=7dabad7a1cff40a59c9820e02e0de925 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:45.933603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-64b3e167-6ad9-4f44-8ee3-be41ce48a74a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:45.934862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-64b3e167-6ad9-4f44-8ee3-be41ce48a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:46.091949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:46.109371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 160/320] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:46.136183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:46.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269be7-a6c9-4b85-903e-10399f3aefec None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:46.315577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca400-ffd3-4740-aa0c-bace60c44b6a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.316132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca400-ffd3-4740-aa0c-bace60c44b6a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.316500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca400-ffd3-4740-aa0c-bace60c44b6a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.318581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 161/321] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:46.323176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:46.324062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.324568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.324859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.325025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5792d-bb68-4a84-b461-685af969d7d7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.325316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5792d-bb68-4a84-b461-685af969d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.325697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5792d-bb68-4a84-b461-685af969d7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.326300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:46.327772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:46.329851 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 161/322] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:46.337455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:46.354380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f6c5792d-bb68-4a84-b461-685af969d7d7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:46.355720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f6c5792d-bb68-4a84-b461-685af969d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:46.415245 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:46.431099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 162/323] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:46.449962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d645dfc-e334-4f41-b0cc-c5309c8be0b9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:46.453979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5792d-bb68-4a84-b461-685af969d7d7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:46.486337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:46.487171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.487426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.487698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] PATH_INFO: `/v3/groups` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.488432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:46.489909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:46.563030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5792d-bb68-4a84-b461-685af969d7d7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:46.589626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:46.600848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 162/324] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Jun 24 07:58:46 2022] POST /identity/v3/groups => generated 226 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:58:46.609132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:46.609132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.609132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.609132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.616556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:46.624796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:46.625931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:46.626859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:46.634729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 163/325] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:46.636052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:46.746179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c14e-dc35-4ba2-8171-2609175e424c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:46.774483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:46.782999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201995-57d3-43b7-b4dc-676edd31c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:46.783677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201995-57d3-43b7-b4dc-676edd31c0ca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.783968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201995-57d3-43b7-b4dc-676edd31c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.784438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201995-57d3-43b7-b4dc-676edd31c0ca None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.785207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33201995-57d3-43b7-b4dc-676edd31c0ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:46.788962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33201995-57d3-43b7-b4dc-676edd31c0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:46.788962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33201995-57d3-43b7-b4dc-676edd31c0ca None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:46.796320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 163/326] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:46.802067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:46.825661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5ac58-82ca-493c-95a6-c81f7f24fc1f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.825981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5ac58-82ca-493c-95a6-c81f7f24fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.826228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5ac58-82ca-493c-95a6-c81f7f24fc1f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.827608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 164/327] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:46.833606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a494a0-3535-486f-bfe1-f66accd30007 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.833896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a494a0-3535-486f-bfe1-f66accd30007 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.834171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a494a0-3535-486f-bfe1-f66accd30007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.852310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b5a494a0-3535-486f-bfe1-f66accd30007 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:46.853538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b5a494a0-3535-486f-bfe1-f66accd30007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:46.927423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9ed29-7469-4503-a021-3a118ff75dfa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:46.940218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 165/328] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:46.961000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a494a0-3535-486f-bfe1-f66accd30007 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:46.964544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:46.965545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:46.965545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:46.965713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] PATH_INFO: `/v3/users/e704c175e2d84422afc2e875b7346038` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:46.967238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e704c175e2d84422afc2e875b7346038)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:46.968790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:46.970665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 164/329] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:46 2022] GET /identity/v3/users/e704c175e2d84422afc2e875b7346038 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:46.976051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:47.046205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:47.100928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a494a0-3535-486f-bfe1-f66accd30007 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:47.115966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd69350-5a6a-47c8-9c9b-8e07e58965b9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:47.144610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:47.157264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:47.158365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:47.158685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:47.158966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:47.163357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:47.164664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:47.165260 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:47.166540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] PATH_INFO: `/v3/system/users/e704c175e2d84422afc2e875b7346038/roles/7dabad7a1cff40a59c9820e02e0de925` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:47.167768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e704c175e2d84422afc2e875b7346038, role_id=7dabad7a1cff40a59c9820e02e0de925)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:47.169775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:47.171613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:47.181860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:47.182847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:47.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 166/330] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:47.190588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:47.263245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 165/331] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Jun 24 07:58:46 2022] PUT /identity/v3/system/users/e704c175e2d84422afc2e875b7346038/roles/7dabad7a1cff40a59c9820e02e0de925 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:58:47.313067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3e56-69c6-41d8-aca7-a9d54e613267 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:47.355173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:47.356393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:47.356914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:47.357485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:47.358511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:47.359110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:47.360759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:47.375536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 167/332] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:47.382095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:47.507674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137552e2-a021-4ace-bf30-c310fd8ce28c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:47.523820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:47.550830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135ada-c455-4832-8a52-498b6ec96275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:47.551704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135ada-c455-4832-8a52-498b6ec96275 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:47.551983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135ada-c455-4832-8a52-498b6ec96275 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:47.552508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135ada-c455-4832-8a52-498b6ec96275 None admin] PATH_INFO: `/v3/users/051fbe0e6316486286cedd70a1a1d8be` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:47.553598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135ada-c455-4832-8a52-498b6ec96275 None admin] RBAC: Authorizing `identity:get_user(user_id=051fbe0e6316486286cedd70a1a1d8be)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:47.555109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135ada-c455-4832-8a52-498b6ec96275 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:47.557081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 166/333] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:47 2022] GET /identity/v3/users/051fbe0e6316486286cedd70a1a1d8be => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:47.567590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:47.618729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:47.681442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121268-69d8-42a8-b1e6-841e0ffa1370 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:47.716539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fe7b7-f1b0-43cc-90b0-2558ca7d46b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:47.717191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fe7b7-f1b0-43cc-90b0-2558ca7d46b5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:47.717472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fe7b7-f1b0-43cc-90b0-2558ca7d46b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:47.717746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fe7b7-f1b0-43cc-90b0-2558ca7d46b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:47.718570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fe7b7-f1b0-43cc-90b0-2558ca7d46b5 None admin] RBAC: Adding query filter params (role.id=ee6f8f6890e94abb9ce1c10ac47520e3, user.id=051fbe0e6316486286cedd70a1a1d8be, scope.system=all) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:47.718877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fe7b7-f1b0-43cc-90b0-2558ca7d46b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:47.720322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fe7b7-f1b0-43cc-90b0-2558ca7d46b5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:47.733496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 168/334] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 07:58:47 2022] GET /identity/v3/role_assignments?user.id=051fbe0e6316486286cedd70a1a1d8be&scope.system=all&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:49.036777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0a55-eaff-498b-9d73-50d086eb1a30 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:49.037307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0a55-eaff-498b-9d73-50d086eb1a30 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:49.037307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0a55-eaff-498b-9d73-50d086eb1a30 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:49.038935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 167/335] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:49.044317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d837-6d56-47ec-af41-cd7fb820a966 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:49.044708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d837-6d56-47ec-af41-cd7fb820a966 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:49.044895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d837-6d56-47ec-af41-cd7fb820a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:49.069187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6864d837-6d56-47ec-af41-cd7fb820a966 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:49.070380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6864d837-6d56-47ec-af41-cd7fb820a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:49.159830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 169/336] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:49.199436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0a55-eaff-498b-9d73-50d086eb1a30 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:49.326016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0a55-eaff-498b-9d73-50d086eb1a30 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:49.371790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:49.372630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:49.372918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:49.373199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:49.389609 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:49.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:49.404473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:49.405270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 168/337] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:49.410876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864d837-6d56-47ec-af41-cd7fb820a966 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:49.455629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:49.534585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864d837-6d56-47ec-af41-cd7fb820a966 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:49.573690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:49.574369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:49.574647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:49.574918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:49.575673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:49.576797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:49.578739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:49.586648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 170/338] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:49.592361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:49.655703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:49.716884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a849-1854-4819-835d-63b95a934cfc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:49.761162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:49.761812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:49.762096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:49.762375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:49.840398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:49.841796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:49.885288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:49.954821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 169/339] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:49.960409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:50.103008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:50.116038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b069-90ef-4e6e-a75a-25b16c9cea25 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:50.159255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd76d6-ce37-4367-becf-b34cecdaacf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:50.160230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd76d6-ce37-4367-becf-b34cecdaacf2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.160506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd76d6-ce37-4367-becf-b34cecdaacf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.160784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd76d6-ce37-4367-becf-b34cecdaacf2 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.164923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd76d6-ce37-4367-becf-b34cecdaacf2 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:50.166378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd76d6-ce37-4367-becf-b34cecdaacf2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:50.172339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 171/340] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:49 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:50.173749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:50.341923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dc392-866b-40cf-abd1-48524662afa3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:50.357006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d590-0259-4582-8e1d-bb4b7fa608c2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.357220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d590-0259-4582-8e1d-bb4b7fa608c2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.357701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d590-0259-4582-8e1d-bb4b7fa608c2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.359413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 172/341] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:50.374401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b1e4-8719-4974-903b-e87bfc3e23d8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.374401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b1e4-8719-4974-903b-e87bfc3e23d8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.374401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b1e4-8719-4974-903b-e87bfc3e23d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.396298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7723b1e4-8719-4974-903b-e87bfc3e23d8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:50.397816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7723b1e4-8719-4974-903b-e87bfc3e23d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:50.397925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34c3ae-e7a4-4d5c-8742-d196d648ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:50.398687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c3ae-e7a4-4d5c-8742-d196d648ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.398968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c3ae-e7a4-4d5c-8742-d196d648ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.399243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c3ae-e7a4-4d5c-8742-d196d648ebd5 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.414921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34c3ae-e7a4-4d5c-8742-d196d648ebd5 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:50.416285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34c3ae-e7a4-4d5c-8742-d196d648ebd5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:50.418408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 170/342] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:50 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:50.419683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba487de-fc86-414c-b86b-7bd6bbc9bfb0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.419966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba487de-fc86-414c-b86b-7bd6bbc9bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.424736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba487de-fc86-414c-b86b-7bd6bbc9bfb0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.424736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 171/343] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:50.432863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60be6b-4315-49d7-aa44-03898662b926 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.433150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60be6b-4315-49d7-aa44-03898662b926 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.433426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60be6b-4315-49d7-aa44-03898662b926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.453198 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:50.467871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ea60be6b-4315-49d7-aa44-03898662b926 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:50.469134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ea60be6b-4315-49d7-aa44-03898662b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:50.505075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 173/344] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:50.506152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723b1e4-8719-4974-903b-e87bfc3e23d8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:50.555338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 172/345] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 07:58:50.557230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e370498-20d6-4019-9b88-a66b46ecb58c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.557688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e370498-20d6-4019-9b88-a66b46ecb58c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.558111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e370498-20d6-4019-9b88-a66b46ecb58c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.559543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 173/346] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:50.560442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e370498-20d6-4019-9b88-a66b46ecb58c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:50.630399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:50.645235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723b1e4-8719-4974-903b-e87bfc3e23d8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:50.696048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899ecee-115c-428b-8968-dd4494c0d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:50.696688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e370498-20d6-4019-9b88-a66b46ecb58c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:50.696984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ecee-115c-428b-8968-dd4494c0d4be None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.697416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ecee-115c-428b-8968-dd4494c0d4be None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.697837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ecee-115c-428b-8968-dd4494c0d4be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.698877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899ecee-115c-428b-8968-dd4494c0d4be None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=12617164ba504ce18054575cb49f5cd5) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:50.699516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899ecee-115c-428b-8968-dd4494c0d4be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:50.702028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899ecee-115c-428b-8968-dd4494c0d4be None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:50.708911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 174/347] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:58:50 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:50.710979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0d756-08c2-44ee-8e2a-3dc8541153ef None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.711515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0d756-08c2-44ee-8e2a-3dc8541153ef None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.712036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0d756-08c2-44ee-8e2a-3dc8541153ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.741999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-aae0d756-08c2-44ee-8e2a-3dc8541153ef None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:50.743762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aae0d756-08c2-44ee-8e2a-3dc8541153ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:50.787168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:50.788011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:50.788457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:50.788739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:50.801214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:50.811207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:50.825145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:50.826143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:50.826934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 174/348] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:50.828450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:50.894667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 175/349] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:50.895844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0d756-08c2-44ee-8e2a-3dc8541153ef None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:50.993590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d03c1-ef3b-4c75-9d6d-f75eb3dd657a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.028503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.031521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772214-514c-4834-b992-c522824fd406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.032241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772214-514c-4834-b992-c522824fd406 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.032535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772214-514c-4834-b992-c522824fd406 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.032815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772214-514c-4834-b992-c522824fd406 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.044258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e772214-514c-4834-b992-c522824fd406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3e772214-514c-4834-b992-c522824fd406 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:51.056246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:51.057200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 175/350] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:51.058151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772214-514c-4834-b992-c522824fd406 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:51.061279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0d756-08c2-44ee-8e2a-3dc8541153ef None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.121827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.123262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.123763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.124272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.125243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:51.125764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:51.127846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:51.128703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.152876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 176/351] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:51.152876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:51.180690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772214-514c-4834-b992-c522824fd406 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.249390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.250261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.252844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.252844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.265726 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:51.277051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:51.277999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:51.278804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 176/352] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:51.279471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:51.313579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd33004-fd3f-41b7-a21f-1ec11c76b18c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.358398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e99a54-3f42-4c09-b1a7-57734bf5c2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.359508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e99a54-3f42-4c09-b1a7-57734bf5c2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.360059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e99a54-3f42-4c09-b1a7-57734bf5c2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.360495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e99a54-3f42-4c09-b1a7-57734bf5c2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.361409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e99a54-3f42-4c09-b1a7-57734bf5c2d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:51.362078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e99a54-3f42-4c09-b1a7-57734bf5c2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:51.363469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e99a54-3f42-4c09-b1a7-57734bf5c2d3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:51.374281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 177/353] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:51.375531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e1c8-14e2-44d7-ab99-4f870ae0f570 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.375819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e1c8-14e2-44d7-ab99-4f870ae0f570 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.376096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e1c8-14e2-44d7-ab99-4f870ae0f570 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.378055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 178/354] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:51.378620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7e1c8-14e2-44d7-ab99-4f870ae0f570 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:51.388874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.406730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe66a9e-f496-49f5-9c4b-89f21027220a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.425803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.449771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.450435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.450723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.451118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.513010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7e1c8-14e2-44d7-ab99-4f870ae0f570 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.537046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:51.538530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:51.560828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a313-b331-4df8-915d-cfdaf6849cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.561513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a313-b331-4df8-915d-cfdaf6849cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.561797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a313-b331-4df8-915d-cfdaf6849cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.562137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a313-b331-4df8-915d-cfdaf6849cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.563185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a313-b331-4df8-915d-cfdaf6849cd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:51.563497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a313-b331-4df8-915d-cfdaf6849cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:51.565731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a313-b331-4df8-915d-cfdaf6849cd6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:51.584218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 179/355] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:51.584218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c828ef-0523-4151-89b6-8ed2a14469ac None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.584218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c828ef-0523-4151-89b6-8ed2a14469ac None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.584218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c828ef-0523-4151-89b6-8ed2a14469ac None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.584218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 180/356] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:51.585571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f7b56-0b6d-412a-a190-dbf1f6673a14 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.585915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f7b56-0b6d-412a-a190-dbf1f6673a14 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.586193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f7b56-0b6d-412a-a190-dbf1f6673a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.608762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bb2f7b56-0b6d-412a-a190-dbf1f6673a14 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:51.609972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bb2f7b56-0b6d-412a-a190-dbf1f6673a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:51.686110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 177/357] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:51.686913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:51.696642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.702448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 181/358] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:51.703338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f7b56-0b6d-412a-a190-dbf1f6673a14 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:51.713914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.820396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db572f-0429-45af-a7b3-d70bc6cdbea2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.833138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f7b56-0b6d-412a-a190-dbf1f6673a14 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:51.860722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.861374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.862268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.862458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.882033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076e20c-64e4-4ace-a1c8-c8f6bc0d7ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:51.882973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076e20c-64e4-4ace-a1c8-c8f6bc0d7ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.883255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076e20c-64e4-4ace-a1c8-c8f6bc0d7ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.883528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076e20c-64e4-4ace-a1c8-c8f6bc0d7ce8 None admin] PATH_INFO: `/v3/users/e704c175e2d84422afc2e875b7346038` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.885217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076e20c-64e4-4ace-a1c8-c8f6bc0d7ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=e704c175e2d84422afc2e875b7346038)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:51.886729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076e20c-64e4-4ace-a1c8-c8f6bc0d7ce8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:51.888773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 182/359] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 07:58:51 2022] GET /identity/v3/users/e704c175e2d84422afc2e875b7346038 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:51.890102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4869d2-a059-428b-b513-da0f4e9e4c95 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:51.890387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4869d2-a059-428b-b513-da0f4e9e4c95 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:51.890661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4869d2-a059-428b-b513-da0f4e9e4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:51.910172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2d4869d2-a059-428b-b513-da0f4e9e4c95 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:51.911591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2d4869d2-a059-428b-b513-da0f4e9e4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:51.953581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:51.954961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:51.975784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.985285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:51.995665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 183/360] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:51.996741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4869d2-a059-428b-b513-da0f4e9e4c95 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.103220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 178/361] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:52.104825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.131435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4869d2-a059-428b-b513-da0f4e9e4c95 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.178351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.179333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.179810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.180259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.181598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:52.183021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:52.185208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 184/362] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:51 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:52.186193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.234568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ff34e-c395-43da-9ea0-b4dcd383a66b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.259596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:52.275995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:52.289645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.290885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.291351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.291803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.306867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:52.315830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:52.316785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:52.317605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:52.318740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 179/363] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:52.319161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.325922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd05be6-599b-41df-b513-62e2983da129 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.369868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.370755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.371177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.371589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.373110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] RBAC: Adding query filter params (role.id=7dabad7a1cff40a59c9820e02e0de925, user.id=e704c175e2d84422afc2e875b7346038, scope.system=all) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:52.373602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:52.375601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:52.393535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 185/364] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/role_assignments?user.id=e704c175e2d84422afc2e875b7346038&scope.system=all&role.id=7dabad7a1cff40a59c9820e02e0de925 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:52.394729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.460229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37229fc0-d0a6-4fa3-8b91-f307d2a4afb8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.504386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.505453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.505936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.506357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.523026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:52.534427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:52.535611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:52.536689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:52.540575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 180/365] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:52.541692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.548097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0df64-ed6c-4049-a339-37192e2bb6fe None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.585920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:52.601299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.603632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.603991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.604126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:52.604795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.606365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:52.607796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:52.609755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 186/366] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:52.610985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.694428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cbfbb-424c-46f8-a80f-e0abc6609c46 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.733168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.734326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.734759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.735231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.737206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:52.739012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:52.741728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 181/367] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:52.742697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.748248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f47348-98f9-4f52-be51-bd55fdf81247 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.789440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.790107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.790750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.791026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.792098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:52.792923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:52.794363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:52.804768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 187/368] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:52.805857 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.866940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab2064-5774-4183-a6b1-e22986a02dc2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:52.870923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:52.882773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:52.917065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:52.918027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:52.918463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:52.918735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:52.919649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:52.920154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:52.921723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:52.930586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 182/369] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:52.931728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:52.953340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d53c4-81b4-423b-83eb-1e4138c63a42 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:53.001634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:53.003172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.003461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.003732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.005035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:53.008096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:53.011896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 188/370] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:53.011896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:53.069552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d851fd-5b0d-4e3e-ad38-78b2bcbe6e79 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:53.109057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:53.110002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.110457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.110905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.113034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=12617164ba504ce18054575cb49f5cd5) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:53.113533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:53.115161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:53.121221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 183/371] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:58:52 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:53.121799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:53.154600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30607-8aa7-4fd6-a114-8687b100716c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:53.172600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:53.184817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:53.206131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:53.206865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.207223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.207577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.265904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05557c8-58f7-4acb-b415-437cf8dd6804 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:53.309625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:53.311192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:53.311421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574ee2-e276-440c-900d-367ea1e2a1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:53.312309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574ee2-e276-440c-900d-367ea1e2a1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.312764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574ee2-e276-440c-900d-367ea1e2a1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.313222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574ee2-e276-440c-900d-367ea1e2a1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.408025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574ee2-e276-440c-900d-367ea1e2a1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:53.410582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574ee2-e276-440c-900d-367ea1e2a1e4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:53.447657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:53.456306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 189/372] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:53.456306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:53.484815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:53.542895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 184/373] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:53.544547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ef91-b10a-42bf-8abb-4e89cf19414d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.544922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ef91-b10a-42bf-8abb-4e89cf19414d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.545266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ef91-b10a-42bf-8abb-4e89cf19414d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.546624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 185/374] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:53.547511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5ef91-b10a-42bf-8abb-4e89cf19414d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:53.596478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f76b0-a10b-45bb-b8d9-d938a7f959a8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:53.640759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:53.641414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.641692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.641966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.643100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:53.643310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:53.644854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:53.651721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 190/375] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:58:53 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:53.652997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:53.706018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5ef91-b10a-42bf-8abb-4e89cf19414d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:53.744571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:53.754207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889470-3150-45fb-aa52-7dd8954ff556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:53.755393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889470-3150-45fb-aa52-7dd8954ff556 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.755820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889470-3150-45fb-aa52-7dd8954ff556 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.762564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889470-3150-45fb-aa52-7dd8954ff556 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.762564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd889470-3150-45fb-aa52-7dd8954ff556 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:53.762564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd889470-3150-45fb-aa52-7dd8954ff556 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:53.763704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 186/376] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:53 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:53.766066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6932ea-cf78-430f-842e-a309592c3e74 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.766543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6932ea-cf78-430f-842e-a309592c3e74 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.767261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6932ea-cf78-430f-842e-a309592c3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.769436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:53.789934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d9f9-f389-48bd-b2e3-397a7256499f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:53.793699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1b6932ea-cf78-430f-842e-a309592c3e74 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:53.795130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1b6932ea-cf78-430f-842e-a309592c3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:53.830237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:53.831621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:53.831903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:53.832177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] PATH_INFO: `/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:53.834289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] RBAC: Authorizing `identity:get_project(project_id=7ed29b44386f4c7ba3757cfe7b05f1c4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:53.835749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:53.837666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 191/377] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:53 2022] GET /identity/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:53.842653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:53.898855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 187/378] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:53.900767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6932ea-cf78-430f-842e-a309592c3e74 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:53.969491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207f5d8-b3c3-47dc-a1ef-be485cfe768a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.006883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.007798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.008155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.008552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.009804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:54.011368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:54.014827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 192/379] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:53 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:54.015265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:54.023287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6932ea-cf78-430f-842e-a309592c3e74 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.042816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:54.053096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:54.061629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.062751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.063283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.063777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] PATH_INFO: `/v3/groups/228f701d258c4be38f8e9da7a4e12caf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.069795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] RBAC: Authorizing `identity:get_group(group_id=228f701d258c4be38f8e9da7a4e12caf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:54.071496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:54.073410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 188/380] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:53 2022] GET /identity/v3/groups/228f701d258c4be38f8e9da7a4e12caf => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:54.074384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:54.126701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522075d-5169-4672-b3cb-31aceac4d2bb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.163987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.164811 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.165305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.165418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.176208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:54.180966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d042-bf2a-4283-9de3-9ac1ead37c29 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:54.184286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:54.185230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:54.186069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 193/381] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:54.186789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:54.221938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.223009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.223505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.223986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.225356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:54.225883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:54.227574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:54.234040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 189/382] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:58:54 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:54.235098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:54.301039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b412-49f8-42d5-9e1d-d92df257270b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.339145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.340166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.340166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.340384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.341231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] RBAC: Adding query filter params (group.id=228f701d258c4be38f8e9da7a4e12caf, role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=7ed29b44386f4c7ba3757cfe7b05f1c4) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:54.341544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:54.343017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:54.350763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 194/383] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:58:54 2022] GET /identity/v3/role_assignments?group.id=228f701d258c4be38f8e9da7a4e12caf&scope.project.id=7ed29b44386f4c7ba3757cfe7b05f1c4&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:54.351840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b931cc-a5cd-49ac-8c46-6b52af961a81 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.378651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:54.410041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:54.413296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.414014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.414301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.414583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.415502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:54.415738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:54.417255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:54.432024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 190/384] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:54.437901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:54.571880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a294-8cd0-4012-9ea1-da1fa6659455 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.619031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.619904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.620190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.620498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.621696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:54.623132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:54.625114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 195/385] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:54 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:54.630614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:54.790967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe517949-e5b5-43c9-8fd2-b6f01aef5fdd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:54.815509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:54.838824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300739e-146d-4cc5-b915-505c55cdab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:54.839617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300739e-146d-4cc5-b915-505c55cdab2b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:54.839903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300739e-146d-4cc5-b915-505c55cdab2b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:54.840181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300739e-146d-4cc5-b915-505c55cdab2b None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:54.844985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300739e-146d-4cc5-b915-505c55cdab2b None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:54.847123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300739e-146d-4cc5-b915-505c55cdab2b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:54.848951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 191/386] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:54 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:54.854877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:54.880124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:54.980951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a905cb-a678-4cd9-bddd-c9085d8b0a05 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:55.015916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76675f73-645e-49ff-a545-7401b6f7a6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:55.016833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675f73-645e-49ff-a545-7401b6f7a6a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:55.017122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675f73-645e-49ff-a545-7401b6f7a6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:55.017401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675f73-645e-49ff-a545-7401b6f7a6a2 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:55.019952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76675f73-645e-49ff-a545-7401b6f7a6a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=12617164ba504ce18054575cb49f5cd5, group_id=66be71b2714d4fdcb8e198ea6aa7d8d7, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:55.021681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76675f73-645e-49ff-a545-7401b6f7a6a2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:55.092359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 196/387] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 07:58:54 2022] PUT /identity/v3/projects/12617164ba504ce18054575cb49f5cd5/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:58:55.459854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bea34-5cfe-4341-bdfb-eece8c6cf4cd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:55.460388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bea34-5cfe-4341-bdfb-eece8c6cf4cd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:55.460388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bea34-5cfe-4341-bdfb-eece8c6cf4cd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:55.462107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 192/388] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:55.467825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789294ce-10fb-4efb-84fc-d4f9e0581bb9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:55.468288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789294ce-10fb-4efb-84fc-d4f9e0581bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:55.468481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789294ce-10fb-4efb-84fc-d4f9e0581bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:55.487817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-789294ce-10fb-4efb-84fc-d4f9e0581bb9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:55.489094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-789294ce-10fb-4efb-84fc-d4f9e0581bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:55.588107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 197/389] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:55.623471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bea34-5cfe-4341-bdfb-eece8c6cf4cd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:55.745930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bea34-5cfe-4341-bdfb-eece8c6cf4cd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:55.787710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:55.788603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:55.788893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:55.789171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:55.800189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:55.808731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:55.809622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:55.810422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 193/390] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:55.816964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789294ce-10fb-4efb-84fc-d4f9e0581bb9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:55.819161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:55.929655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789294ce-10fb-4efb-84fc-d4f9e0581bb9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:55.965778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:55.966454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:55.966739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:55.967017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:55.967773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:55.968080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:55.969478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:55.978208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 198/391] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:55.984978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:56.037050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:56.091347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ead6c-e404-4a09-b3ae-6fe34381d088 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:56.125387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcba646-b999-4aa5-ae7e-1e603f139b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:56.126284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcba646-b999-4aa5-ae7e-1e603f139b49 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.126576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcba646-b999-4aa5-ae7e-1e603f139b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.126859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcba646-b999-4aa5-ae7e-1e603f139b49 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.128110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcba646-b999-4aa5-ae7e-1e603f139b49 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:56.129637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcba646-b999-4aa5-ae7e-1e603f139b49 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:56.131594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 194/392] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:55 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:56.136685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:56.203155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:56.233673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103096-1839-4029-b3ff-b05a0dd04651 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.233987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103096-1839-4029-b3ff-b05a0dd04651 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.234296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103096-1839-4029-b3ff-b05a0dd04651 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.236882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 195/393] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:56.245774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337c22-ec5c-46c2-836f-0eae40d25963 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.246187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337c22-ec5c-46c2-836f-0eae40d25963 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.246694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337c22-ec5c-46c2-836f-0eae40d25963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.252242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cea280-5792-4526-8377-70a73b86ee5b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:56.279539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-88337c22-ec5c-46c2-836f-0eae40d25963 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:56.281577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-88337c22-ec5c-46c2-836f-0eae40d25963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:56.304902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:56.306006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.306435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.306858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.308998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:56.310570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:56.316027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 199/394] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:56 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:56.329152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:56.376000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 196/395] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:56.413294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337c22-ec5c-46c2-836f-0eae40d25963 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:56.467469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c9744-1f2f-4ad3-9da9-bbf4f9ee5071 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:56.468885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:56.528487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337c22-ec5c-46c2-836f-0eae40d25963 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:56.551144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:56.568105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:56.568857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.569144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.569414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.572351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:56.574956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.575235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.575513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.587110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:56.589311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] RBAC: Authorizing `identity:create_grant(project_id=12617164ba504ce18054575cb49f5cd5, group_id=66be71b2714d4fdcb8e198ea6aa7d8d7, role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:56.590938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:56.601979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:56.602963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:56.603766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 197/396] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:56.610639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:56.669029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 200/397] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 07:58:56 2022] PUT /identity/v3/projects/12617164ba504ce18054575cb49f5cd5/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/d8548213eacf423fb6e7c5832be20d3b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:56.729340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebfe0a-5102-4aff-8c65-96775be832f0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:56.731768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:56.766239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ae217-cd3c-406a-8d66-9b55293d4e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:56.766967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ae217-cd3c-406a-8d66-9b55293d4e98 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.767258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ae217-cd3c-406a-8d66-9b55293d4e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.767534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ae217-cd3c-406a-8d66-9b55293d4e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.768867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ae217-cd3c-406a-8d66-9b55293d4e98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:56.769172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ae217-cd3c-406a-8d66-9b55293d4e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:56.770840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ae217-cd3c-406a-8d66-9b55293d4e98 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:56.781002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 198/398] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:56.789595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:56.879439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927726a-128e-4053-86cc-83eb2f6af525 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.879745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927726a-128e-4053-86cc-83eb2f6af525 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.879976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927726a-128e-4053-86cc-83eb2f6af525 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.882832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 199/399] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:56.888902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b04bb2-f84f-43f5-b498-5d90d61a7abc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.889625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b04bb2-f84f-43f5-b498-5d90d61a7abc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.889913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b04bb2-f84f-43f5-b498-5d90d61a7abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.911858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-10b04bb2-f84f-43f5-b498-5d90d61a7abc None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:56.913162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-10b04bb2-f84f-43f5-b498-5d90d61a7abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:56.934252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f515cf-bf6b-4e24-bf0f-1d1498eb7784 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:56.981393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d39d0-a51e-4eb4-a8bf-9739d3fefd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:56.982553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d39d0-a51e-4eb4-a8bf-9739d3fefd07 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.982830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d39d0-a51e-4eb4-a8bf-9739d3fefd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.983107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d39d0-a51e-4eb4-a8bf-9739d3fefd07 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.988225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d39d0-a51e-4eb4-a8bf-9739d3fefd07 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:56.988225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d39d0-a51e-4eb4-a8bf-9739d3fefd07 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:56.989021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 201/400] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:56 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:56.990350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba91f8b-dd85-4cc0-b1d4-147d41041dc7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:56.990763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba91f8b-dd85-4cc0-b1d4-147d41041dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:56.991169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba91f8b-dd85-4cc0-b1d4-147d41041dc7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:56.992791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 202/401] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:56.997208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba91f8b-dd85-4cc0-b1d4-147d41041dc7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.003632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 200/402] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:57.004950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbda5-cb36-4254-a8c1-4aec9fbc4d87 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.005239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbda5-cb36-4254-a8c1-4aec9fbc4d87 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.005518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbda5-cb36-4254-a8c1-4aec9fbc4d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.025662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e7abbda5-cb36-4254-a8c1-4aec9fbc4d87 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:57.027114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e7abbda5-cb36-4254-a8c1-4aec9fbc4d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:57.069805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:57.102056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 201/403] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:57.103315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abbda5-cb36-4254-a8c1-4aec9fbc4d87 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.128413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba91f8b-dd85-4cc0-b1d4-147d41041dc7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.138558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:57.166215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:57.167438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.167875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.169563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.170022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:57.171789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:57.174123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 203/404] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:56 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:57.175138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.228236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abbda5-cb36-4254-a8c1-4aec9fbc4d87 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.268665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:57.269957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.270447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.271157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.283598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:57.292297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:57.295891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 202/405] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:57.297058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.315649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c406b69-42af-4cb0-9450-49280984abdb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.346604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:57.355576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:57.356684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.358138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.358138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.369589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:57.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:57.381164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:57.382027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:57.384882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 204/406] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:57.385889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.409718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:57.430421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da68f-78d3-42cb-91f1-a3d9ccd5940f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.476755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:57.478635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.479265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.479865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.484846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d23a9abfe764ab4912e967737d8cbd9, group_id=66be71b2714d4fdcb8e198ea6aa7d8d7, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:57.486526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:57.499293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c862b-ee61-44eb-9699-cae76961ad9b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.535584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:57.536324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.536606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.536936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.537691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:57.538050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:57.539450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:57.552518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 205/407] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:57.552518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.602733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 203/408] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 07:58:57 2022] PUT /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:57.604181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.625276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:57.735432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5436c-376c-493d-9e84-5a18b866fdfa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.808322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c661692-9bc7-4871-87fe-615d662754e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:57.809303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661692-9bc7-4871-87fe-615d662754e5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.809758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661692-9bc7-4871-87fe-615d662754e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.810216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661692-9bc7-4871-87fe-615d662754e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.810888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad52335-8dbd-484b-9080-27294cb45460 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.811144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c661692-9bc7-4871-87fe-615d662754e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:57.811449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c661692-9bc7-4871-87fe-615d662754e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:57.812845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c661692-9bc7-4871-87fe-615d662754e5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:57.823004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 206/409] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:57.824319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f819f1-c8b8-402a-a933-fdebb8abca6b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.824605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f819f1-c8b8-402a-a933-fdebb8abca6b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.824877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f819f1-c8b8-402a-a933-fdebb8abca6b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.826269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 207/410] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:57.829924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f819f1-c8b8-402a-a933-fdebb8abca6b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:57.862191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5a5a-1d75-4473-a740-32cfc83db317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:57.863868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5a5a-1d75-4473-a740-32cfc83db317 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.864150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5a5a-1d75-4473-a740-32cfc83db317 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.864694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5a5a-1d75-4473-a740-32cfc83db317 None admin] PATH_INFO: `/v3/groups/228f701d258c4be38f8e9da7a4e12caf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.866297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5a5a-1d75-4473-a740-32cfc83db317 None admin] RBAC: Authorizing `identity:get_group(group_id=228f701d258c4be38f8e9da7a4e12caf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:57.868428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5a5a-1d75-4473-a740-32cfc83db317 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:57.870667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 204/411] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:57 2022] GET /identity/v3/groups/228f701d258c4be38f8e9da7a4e12caf => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:57.872776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c901ac-5ff0-478c-873b-f5f7ebee3ecd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:57.873341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c901ac-5ff0-478c-873b-f5f7ebee3ecd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:57.873841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c901ac-5ff0-478c-873b-f5f7ebee3ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:57.897759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-25c901ac-5ff0-478c-873b-f5f7ebee3ecd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:57.899292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-25c901ac-5ff0-478c-873b-f5f7ebee3ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:57.910512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:57.970059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f819f1-c8b8-402a-a933-fdebb8abca6b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:57.972075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 205/412] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:58:57.973326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c901ac-5ff0-478c-873b-f5f7ebee3ecd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:58.004478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:58.029875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.030758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.031041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.031320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.033100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:58.034993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:58.041419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 208/413] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:57 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:58.042282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:58.123466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c901ac-5ff0-478c-873b-f5f7ebee3ecd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:58.163094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.164354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.164830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.165313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] PATH_INFO: `/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.166715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed29b44386f4c7ba3757cfe7b05f1c4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:58.168278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:58.170224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 206/414] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:57 2022] GET /identity/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:58.176475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:58.177065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323c486-6f40-44c2-990c-449930367f61 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:58.192252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:58.225997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.227906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.229019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.229621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.249478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:58.257844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:58.258755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:58:58.259570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:58.263853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 209/415] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:58:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:58:58.264691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:58.310676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:58.311466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6093e-9631-41d6-b5ba-2df0a8b567f5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:58.362367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.364232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.364996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.365472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.367698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:58.369796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:58.378279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 207/416] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:58 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:58.378279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:58.382049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7080-9270-43b5-85d2-63f19157bc95 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:58.418511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.419451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.419729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.420047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] PATH_INFO: `/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4/groups/228f701d258c4be38f8e9da7a4e12caf/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.422102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] RBAC: Authorizing `identity:create_grant(project_id=7ed29b44386f4c7ba3757cfe7b05f1c4, group_id=228f701d258c4be38f8e9da7a4e12caf, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:58.423634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:58.475586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:58.497368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd0963-5c88-4571-93b7-502f1a7a6097 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:58.500273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 210/417] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 07:58:58 2022] PUT /identity/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4/groups/228f701d258c4be38f8e9da7a4e12caf/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:58.501488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:58.573564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.574696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.578277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.578832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.582168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:58.582168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:58.587229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:58.600178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 208/418] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:58:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:58.609258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:58.708558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:58.715699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579aea-ec21-48e1-85bf-3bf3a96c455a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:58.763499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2038-ee29-4dee-b11f-7240672ec579 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:58.766041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221d7cd-edd2-4533-9ee2-041ee5de92cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.766914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d7cd-edd2-4533-9ee2-041ee5de92cb None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.767191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d7cd-edd2-4533-9ee2-041ee5de92cb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.767462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d7cd-edd2-4533-9ee2-041ee5de92cb None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.773018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221d7cd-edd2-4533-9ee2-041ee5de92cb None admin] RBAC: Authorizing `identity:create_grant(project_id=5d23a9abfe764ab4912e967737d8cbd9, group_id=66be71b2714d4fdcb8e198ea6aa7d8d7, role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:58.774706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221d7cd-edd2-4533-9ee2-041ee5de92cb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:58.809282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:58.810349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:58.810832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:58.811322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:58.826132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:58.856254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 211/419] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 07:58:58 2022] PUT /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9/groups/66be71b2714d4fdcb8e198ea6aa7d8d7/roles/d8548213eacf423fb6e7c5832be20d3b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:58:58.905457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:58.907258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:59.049620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd354-2b63-4a44-8bad-2081deb9373a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.050195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd354-2b63-4a44-8bad-2081deb9373a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.050653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd354-2b63-4a44-8bad-2081deb9373a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.052488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 209/420] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:58:59.053129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 212/421] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:58:59.056930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:59.058976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f28f-94c1-4390-9308-d3ff58e677e6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.059479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f28f-94c1-4390-9308-d3ff58e677e6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.059986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f28f-94c1-4390-9308-d3ff58e677e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.083590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bd17f28f-94c1-4390-9308-d3ff58e677e6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:58:59.084684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bd17f28f-94c1-4390-9308-d3ff58e677e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:58:59.115522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:59.191369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 213/422] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:58:59.205037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38eac1-3637-4ec3-a6d4-9dd44a140663 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:59.251005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:59.251864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.252148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.255724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.255824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17f28f-94c1-4390-9308-d3ff58e677e6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:59.257948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:59.261708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:59.264030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 210/423] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:58:59 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:59.271104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:59.432439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba609-5912-4c5f-8005-47e189d047f4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:59.440719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:59.444563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:59.471693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:59.472606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.472914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.473522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.474740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:59.475167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17f28f-94c1-4390-9308-d3ff58e677e6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:59.476225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:59.478649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 211/424] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:58:59 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:59.484376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:59.548041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:59.548886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.549816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.550112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.561382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:58:59.569706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:58:59.570623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:58:59.571447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 214/425] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:58:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:58:59.576826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:59.682393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed707a7-b33c-4152-87a8-dc12a65b9e0e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:59.718025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:59.718629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.718881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.719163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.719926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:59.720279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:59.722382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:59.731215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 215/426] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:58:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:58:59.737182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:58:59.750160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83173da-b4b0-4b8b-a2bd-ee87f53303f7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:59.752573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:58:59.797761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6ffe0-7694-4e77-bd33-fcafaea85815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:59.798584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ffe0-7694-4e77-bd33-fcafaea85815 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.798878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ffe0-7694-4e77-bd33-fcafaea85815 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.799266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ffe0-7694-4e77-bd33-fcafaea85815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.804217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6ffe0-7694-4e77-bd33-fcafaea85815 None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=12617164ba504ce18054575cb49f5cd5) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:58:59.804217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6ffe0-7694-4e77-bd33-fcafaea85815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:58:59.804217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6ffe0-7694-4e77-bd33-fcafaea85815 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:58:59.809483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 212/427] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:58:59 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 611 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:58:59.894751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c8e43-d36c-4c6f-9fdb-42e9f4816b1d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:58:59.933316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:58:59.934222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.934648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.935102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.957721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc1bc-e420-43a9-88fe-bdffb85b6275 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.958418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc1bc-e420-43a9-88fe-bdffb85b6275 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.958910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc1bc-e420-43a9-88fe-bdffb85b6275 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:58:59.960883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 213/428] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:58:59.966985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e54f-3c66-4d3a-895d-b0fd0f5eae09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:58:59.967680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e54f-3c66-4d3a-895d-b0fd0f5eae09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:58:59.968242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e54f-3c66-4d3a-895d-b0fd0f5eae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:00.002091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ca25e54f-3c66-4d3a-895d-b0fd0f5eae09 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:00.003888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ca25e54f-3c66-4d3a-895d-b0fd0f5eae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:00.014615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:00.016096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:00.032397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:00.070811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:00.123197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 214/429] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:00.135964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 216/430] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:59:00.141248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25e54f-3c66-4d3a-895d-b0fd0f5eae09 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:00.152567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:00.265656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25e54f-3c66-4d3a-895d-b0fd0f5eae09 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:00.280581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74007-39d8-4ead-ae4b-6d31b40b7308 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:00.294844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:00.305869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:00.307155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:00.307626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:00.308052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] PATH_INFO: `/v3/projects/12617164ba504ce18054575cb49f5cd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:00.309418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=12617164ba504ce18054575cb49f5cd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:00.311014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:00.313549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 215/431] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:59:00 2022] GET /identity/v3/projects/12617164ba504ce18054575cb49f5cd5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:00.320305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:00.320449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:00.321177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:00.321467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:00.321730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:00.336189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:00.343892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:00.344826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:00.345672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 217/432] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:00.353150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:00.371834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:00.436840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd716e-76c3-4ab6-9b34-b5cd1a982fa8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:00.460781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154f296-43ad-4340-9eea-433fdfbd4f4a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:00.476963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:00.478156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:00.478656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:00.479131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:00.480678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:00.482322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:00.485574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 216/433] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:59:00 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:00.491710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:00.497408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:00.497408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:00.497742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:00.497952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:00.498705 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:00.499011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:00.500428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:00.511572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 218/434] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 07:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:00.517005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:00.553698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:00.625521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f87150-6379-4752-b985-a67afe9e4c2a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:00.635656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbd6dd-322a-4e72-a24d-3216d67b2baf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:00.646651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:00.662374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:00.663077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:00.663420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:00.663701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:00.679928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:00.680961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:00.681449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:00.681927 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:00.682978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=12617164ba504ce18054575cb49f5cd5) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:00.683521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:00.685585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:00.694147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 217/435] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:59:00 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=12617164ba504ce18054575cb49f5cd5&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:00.742097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:00.743645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:00.787548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:00.866876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 219/436] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:00.872955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:00.993789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5b82-4743-4798-9226-1f2917988aad None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.030386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19b39c-f36d-4bde-b838-23508e48470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.031249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19b39c-f36d-4bde-b838-23508e48470a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.031531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19b39c-f36d-4bde-b838-23508e48470a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.031807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19b39c-f36d-4bde-b838-23508e48470a None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.033042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19b39c-f36d-4bde-b838-23508e48470a None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:01.035124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19b39c-f36d-4bde-b838-23508e48470a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:01.037235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 218/437] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:59:00 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:01.042692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.047593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e0a3-df08-4261-b388-6f95205837eb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.047593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e0a3-df08-4261-b388-6f95205837eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.047593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e0a3-df08-4261-b388-6f95205837eb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.049293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 219/438] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:01.055664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b126-01c2-455e-9ceb-1369ab433654 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.055939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b126-01c2-455e-9ceb-1369ab433654 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.056259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b126-01c2-455e-9ceb-1369ab433654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.076030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b533b126-01c2-455e-9ceb-1369ab433654 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:01.077263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b533b126-01c2-455e-9ceb-1369ab433654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:01.122536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:01.162333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 220/439] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:01.177425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f3b35-7337-4541-928f-14c9547870fb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.187484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b126-01c2-455e-9ceb-1369ab433654 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.213829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.214802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.215329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.215504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.216677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:01.218596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:01.225349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 220/440] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:01.226294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.228966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:01.300270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b126-01c2-455e-9ceb-1369ab433654 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.328566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0ed82-64cf-4ad2-b48b-bacd93e9a34a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.334687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397ccda-8147-4edc-83ba-e27ecedcffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.335481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397ccda-8147-4edc-83ba-e27ecedcffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.335759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397ccda-8147-4edc-83ba-e27ecedcffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.336035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397ccda-8147-4edc-83ba-e27ecedcffe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.347019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397ccda-8147-4edc-83ba-e27ecedcffe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b397ccda-8147-4edc-83ba-e27ecedcffe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:01.354620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:01.355529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:01.356367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 221/441] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:01.357396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72dabf-f654-4463-bdc3-f41ea0e82397 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.357744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72dabf-f654-4463-bdc3-f41ea0e82397 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.358028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72dabf-f654-4463-bdc3-f41ea0e82397 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.359318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 222/442] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:01.363942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72dabf-f654-4463-bdc3-f41ea0e82397 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.369007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f7feb-ffe8-4ef4-bfe3-0106d3a90020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.369663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7feb-ffe8-4ef4-bfe3-0106d3a90020 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.369949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7feb-ffe8-4ef4-bfe3-0106d3a90020 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.370227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7feb-ffe8-4ef4-bfe3-0106d3a90020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.371061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f7feb-ffe8-4ef4-bfe3-0106d3a90020 None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=ee6f8f6890e94abb9ce1c10ac47520e3, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:01.371374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f7feb-ffe8-4ef4-bfe3-0106d3a90020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:01.372864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f7feb-ffe8-4ef4-bfe3-0106d3a90020 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:01.379078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 221/443] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=ee6f8f6890e94abb9ce1c10ac47520e3 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:01.380325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bdb66-4365-41b4-b910-145090fa96b4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.380614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bdb66-4365-41b4-b910-145090fa96b4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.380892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bdb66-4365-41b4-b910-145090fa96b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.399236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-049bdb66-4365-41b4-b910-145090fa96b4 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:01.400625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-049bdb66-4365-41b4-b910-145090fa96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:01.412423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:01.478420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:01.488937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 222/444] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:01.493021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72dabf-f654-4463-bdc3-f41ea0e82397 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.513521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bdb66-4365-41b4-b910-145090fa96b4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.537382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.538052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.538350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.538642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.539379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:01.539682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:01.541090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:01.552337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 223/445] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:01.557630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.636800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bdb66-4365-41b4-b910-145090fa96b4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.671238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:01.675916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.676766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.677039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.677311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.680880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea5665-4208-4155-95d0-ae04a66833c6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.690651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:01.698866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:01.699772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:01.700711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 223/446] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:01.705837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.726558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.727620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.727906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.728185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.771661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:01.802663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:01.804163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:01.816038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486dfb4-01d8-4e25-b78c-e9994f1bc10d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.850459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:01.851138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:01.851422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:01.851703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:01.852487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:01.852795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:01.854148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:01.862925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 224/447] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:01.868523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.891969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:01.901774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 224/448] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:59:01.907215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:01.967339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc22bc-f5dc-4d11-82e7-eec36f8e5d5e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:01.984698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:02.001669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:02.002803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:02.003094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:02.003372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:02.004562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebde6f3-ff33-4ebe-87db-ea84599c2970 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:02.038858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:02.039701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:02.039979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:02.040279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] PATH_INFO: `/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:02.041501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed29b44386f4c7ba3757cfe7b05f1c4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:02.042919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:02.044621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 225/449] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/projects/7ed29b44386f4c7ba3757cfe7b05f1c4 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:02.050418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:02.071250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:02.072666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:02.109024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:02.149446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03699fbc-8aa2-4447-bc05-8d85c29f26b1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:02.169776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 225/450] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:59:02.175512 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:02.182570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:02.183413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:02.183697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:02.183973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] PATH_INFO: `/v3/groups/228f701d258c4be38f8e9da7a4e12caf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:02.185177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] RBAC: Authorizing `identity:get_group(group_id=228f701d258c4be38f8e9da7a4e12caf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:02.186611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:02.188247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 226/451] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:59:02 2022] GET /identity/v3/groups/228f701d258c4be38f8e9da7a4e12caf => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:02.194333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:02.197044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:02.280549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5e97c-3ed1-44d4-b709-224323c63957 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:02.298121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8b7e4-3e25-4c32-a793-a30f18e4569c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:02.314481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:02.315771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:02.316046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:02.316349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] PATH_INFO: `/v3/projects/5d23a9abfe764ab4912e967737d8cbd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:02.317521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] RBAC: Authorizing `identity:get_project(project_id=5d23a9abfe764ab4912e967737d8cbd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:02.321550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:02.321550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 226/452] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 07:59:02 2022] GET /identity/v3/projects/5d23a9abfe764ab4912e967737d8cbd9 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:02.323700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:02.326039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:02.332442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:02.333092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:02.333373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:02.333649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:02.334472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] RBAC: Adding query filter params (group.id=228f701d258c4be38f8e9da7a4e12caf, role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=7ed29b44386f4c7ba3757cfe7b05f1c4) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:02.334784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:02.336230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:02.341919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 227/453] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:59:02 2022] GET /identity/v3/role_assignments?group.id=228f701d258c4be38f8e9da7a4e12caf&scope.project.id=7ed29b44386f4c7ba3757cfe7b05f1c4&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:02.417173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:02.433342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03a58d-84bc-470d-8237-0555d0e599a9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:02.471107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8b279-c4ae-438c-95f3-d6423c94e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:02.471984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8b279-c4ae-438c-95f3-d6423c94e458 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:02.472289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8b279-c4ae-438c-95f3-d6423c94e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:02.472563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8b279-c4ae-438c-95f3-d6423c94e458 None admin] PATH_INFO: `/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:02.473788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8b279-c4ae-438c-95f3-d6423c94e458 None admin] RBAC: Authorizing `identity:get_group(group_id=66be71b2714d4fdcb8e198ea6aa7d8d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:02.475221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8b279-c4ae-438c-95f3-d6423c94e458 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:02.476915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 227/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 07:59:02 2022] GET /identity/v3/groups/66be71b2714d4fdcb8e198ea6aa7d8d7 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:02.482815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:02.667144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714cfd-7c85-4922-a643-18b5aa0998aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:02.667144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4655484-362b-4978-bcd5-57fac411c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:02.667144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655484-362b-4978-bcd5-57fac411c939 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:02.667144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655484-362b-4978-bcd5-57fac411c939 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:02.667628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655484-362b-4978-bcd5-57fac411c939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:02.667628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4655484-362b-4978-bcd5-57fac411c939 None admin] RBAC: Adding query filter params (group.id=66be71b2714d4fdcb8e198ea6aa7d8d7, role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=5d23a9abfe764ab4912e967737d8cbd9) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:02.667628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4655484-362b-4978-bcd5-57fac411c939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:02.667628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4655484-362b-4978-bcd5-57fac411c939 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:02.667628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 228/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 07:59:02 2022] GET /identity/v3/role_assignments?group.id=66be71b2714d4fdcb8e198ea6aa7d8d7&scope.project.id=5d23a9abfe764ab4912e967737d8cbd9&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:05.178440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2bcf9-0fbd-4ff7-9b61-82303d4ed72c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.178993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2bcf9-0fbd-4ff7-9b61-82303d4ed72c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.178993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2bcf9-0fbd-4ff7-9b61-82303d4ed72c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.180623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 228/456] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:05.185928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8e2e3-35c5-4aac-b9b6-d732844867ea None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.186315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8e2e3-35c5-4aac-b9b6-d732844867ea None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.186512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8e2e3-35c5-4aac-b9b6-d732844867ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.213267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-21d8e2e3-35c5-4aac-b9b6-d732844867ea None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:05.214463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-21d8e2e3-35c5-4aac-b9b6-d732844867ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:05.283331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:05.312337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 229/457] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:59:05.362214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2bcf9-0fbd-4ff7-9b61-82303d4ed72c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:05.385257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2600-eed1-4872-ae13-d29377b4c989 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.385723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2600-eed1-4872-ae13-d29377b4c989 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.386219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2600-eed1-4872-ae13-d29377b4c989 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.388803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 230/458] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:05.399808 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566eac5-41db-45ff-8217-e63b78955691 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.400169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566eac5-41db-45ff-8217-e63b78955691 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.400539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566eac5-41db-45ff-8217-e63b78955691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.432309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c566eac5-41db-45ff-8217-e63b78955691 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:05.435494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c566eac5-41db-45ff-8217-e63b78955691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:05.549015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 231/459] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:05.566564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2bcf9-0fbd-4ff7-9b61-82303d4ed72c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:05.584391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566eac5-41db-45ff-8217-e63b78955691 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:05.639187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:05.639977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.640278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.640550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.668073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:05.669559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:05.697866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:05.698785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:05.700118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:05.700118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:05.700118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:05.700118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:05.700118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 229/460] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:05.705107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:05.725845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:05.739615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566eac5-41db-45ff-8217-e63b78955691 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:05.759306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:05.789437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7bd78-ceeb-498e-a9d0-678e2b8e39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:05.790245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7bd78-ceeb-498e-a9d0-678e2b8e39c1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.790531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7bd78-ceeb-498e-a9d0-678e2b8e39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.790810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7bd78-ceeb-498e-a9d0-678e2b8e39c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.805888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7bd78-ceeb-498e-a9d0-678e2b8e39c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:05.807536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7bd78-ceeb-498e-a9d0-678e2b8e39c1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7ca7bd78-ceeb-498e-a9d0-678e2b8e39c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:05.827112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:05.828051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:05.829400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:05.829400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:05.829400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:05.829400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:05.829400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 232/461] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:05.831464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55175dfa-7497-4ea9-8969-fbbbde4a6d16 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.831464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55175dfa-7497-4ea9-8969-fbbbde4a6d16 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.831464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55175dfa-7497-4ea9-8969-fbbbde4a6d16 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.832622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 233/462] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:05.838285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3fdff-cb02-4069-833b-53c96115dcb4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.838601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3fdff-cb02-4069-833b-53c96115dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.838885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3fdff-cb02-4069-833b-53c96115dcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.843624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78d7d-c213-496b-b148-33bcadc6474e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:05.858765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4ec3fdff-cb02-4069-833b-53c96115dcb4 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:05.860306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4ec3fdff-cb02-4069-833b-53c96115dcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:05.881890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:05.882473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.882751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.883085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.883811 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:05.884142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:05.885526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:05.899323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 230/463] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:05.899957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:05.944600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 234/464] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:59:05.946038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c803b6-08de-4209-9578-a7298dbe289f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:05.946331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c803b6-08de-4209-9578-a7298dbe289f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:05.946611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c803b6-08de-4209-9578-a7298dbe289f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:05.948103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 235/465] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:05.952872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c803b6-08de-4209-9578-a7298dbe289f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:05.980226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:06.015737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca4a23-20a0-4065-85b0-45ad57a4f93d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.051207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb8ba-0165-4171-8b66-496803120c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.051890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb8ba-0165-4171-8b66-496803120c31 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.052176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb8ba-0165-4171-8b66-496803120c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.052505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb8ba-0165-4171-8b66-496803120c31 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.053231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb8ba-0165-4171-8b66-496803120c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:06.053536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb8ba-0165-4171-8b66-496803120c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.054912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb8ba-0165-4171-8b66-496803120c31 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.060396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:06.065762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c803b6-08de-4209-9578-a7298dbe289f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.071631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 231/466] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:06.071631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af30f-3e30-4bd8-978c-0b7554440b40 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.071631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af30f-3e30-4bd8-978c-0b7554440b40 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.071631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af30f-3e30-4bd8-978c-0b7554440b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.086922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d81af30f-3e30-4bd8-978c-0b7554440b40 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:06.088119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d81af30f-3e30-4bd8-978c-0b7554440b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:06.107586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.108483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.109002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.109503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.110774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.112294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.165378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 232/467] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:06.166227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af30f-3e30-4bd8-978c-0b7554440b40 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:06.223794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 236/468] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:59:05 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:06.233304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:06.234465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:06.295463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af30f-3e30-4bd8-978c-0b7554440b40 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.345847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.346784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.347151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.347473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.363664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.365203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.383995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaf1aa-3f4c-4ce9-b496-cdf14fe72b0a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:06.388011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:06.388893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:06.389739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:06.389739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:06.389739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:06.389739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:06.391951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 233/469] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:06.393647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:06.428937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.429279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.429514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.429796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.430512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.432001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.514392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ed38-5b60-4c68-8d62-72b20a15e1c2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.521215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 237/470] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:59:06 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:06.522874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:06.525032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:06.543284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:06.560827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.562762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.563564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.564069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.580032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.584136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:06.609317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:06.610249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:06.611127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:06.611127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:06.611127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:06.611127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:06.611127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 234/471] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:06.618549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:06.653045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d9be-f729-4a8b-864e-d67def67d172 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.691133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.692184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.692716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.693219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.694149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:06.694657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.696227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.710912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 238/472] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:06.719119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:06.791976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab80e35-b128-4762-87c7-b43ddb09c039 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.833629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:06.837049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9a2de-9af0-43a7-93e8-7049d6122fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.837419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9a2de-9af0-43a7-93e8-7049d6122fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.837701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9a2de-9af0-43a7-93e8-7049d6122fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.837982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9a2de-9af0-43a7-93e8-7049d6122fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.838710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9a2de-9af0-43a7-93e8-7049d6122fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:06.839015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9a2de-9af0-43a7-93e8-7049d6122fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.842013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9a2de-9af0-43a7-93e8-7049d6122fe9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.853579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 235/473] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:06.856222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed7a1-fc68-4b91-8018-4df79fc5b76c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.856222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed7a1-fc68-4b91-8018-4df79fc5b76c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.856222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed7a1-fc68-4b91-8018-4df79fc5b76c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.862661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 236/474] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:06.863267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed7a1-fc68-4b91-8018-4df79fc5b76c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:06.871369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2f006-ea59-421d-801b-7d9b45ab03f3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:06.891665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:06.913135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c9d33-1919-4fed-9a5d-cdc6806302e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:06.913817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9d33-1919-4fed-9a5d-cdc6806302e3 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:06.914097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9d33-1919-4fed-9a5d-cdc6806302e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:06.914371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9d33-1919-4fed-9a5d-cdc6806302e3 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:06.915078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c9d33-1919-4fed-9a5d-cdc6806302e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:06.916560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c9d33-1919-4fed-9a5d-cdc6806302e3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:06.979731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed7a1-fc68-4b91-8018-4df79fc5b76c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:07.016241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:07.025612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:07.025612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:07.025612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:07.025612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:07.025612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:07.052274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 239/475] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:59:06 2022] POST /identity/v3/users => generated 248 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:07.060545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6924-923e-4c0c-9481-71c3570c9d17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:07.060545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6924-923e-4c0c-9481-71c3570c9d17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:07.060545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6924-923e-4c0c-9481-71c3570c9d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:07.078189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-86ce6924-923e-4c0c-9481-71c3570c9d17 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:07.079333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-86ce6924-923e-4c0c-9481-71c3570c9d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:07.161293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 237/476] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:59:06 2022] POST /identity/v3/users => generated 249 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:07.164790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 240/477] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:07.188403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:07.301746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:07.329813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac431-5b25-4731-9f82-a493ed0c4304 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:07.370175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:07.370913 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:07.371196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:07.371524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:07.372330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:07.373724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:07.416896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.sql.core [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 07:59:07.416896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 07:59:07.416896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [parameters: {'id': 'cadbdfce0f8f4fef81965b51f3f054c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 07:59:07.416896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jun 24 07:59:07.433467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 07:59:07.434383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application yield resource Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise self.value Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application session.commit() Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 07:59:07.435382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.flush() Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application compat.raise_( Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 07:59:07.436290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 07:59:07.437234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 07:59:07.438070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [parameters: {'id': 'cadbdfce0f8f4fef81965b51f3f054c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:07.438853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 07:59:07.439778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:07.442467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 238/478] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 07:59:07 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:07.442611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce6924-923e-4c0c-9481-71c3570c9d17 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:07.504765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:07.557579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce6924-923e-4c0c-9481-71c3570c9d17 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:07.601323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcd439-4b0a-4658-8d64-141a96551847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:07.602134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcd439-4b0a-4658-8d64-141a96551847 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:07.602417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcd439-4b0a-4658-8d64-141a96551847 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:07.602693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcd439-4b0a-4658-8d64-141a96551847 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:07.624103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcd439-4b0a-4658-8d64-141a96551847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d3bcd439-4b0a-4658-8d64-141a96551847 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:07.630106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:07.630981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 07:59:07.631785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:07.634555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 241/479] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:07.639879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:07.759070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badac11-a52a-4c9a-a7d1-919590fb12b1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:07.798649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d0477-8675-4ffd-80a8-a90b9eb0ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:07.799378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d0477-8675-4ffd-80a8-a90b9eb0ab51 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:07.799666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d0477-8675-4ffd-80a8-a90b9eb0ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:07.799944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d0477-8675-4ffd-80a8-a90b9eb0ab51 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:07.800739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d0477-8675-4ffd-80a8-a90b9eb0ab51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:07.801534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d0477-8675-4ffd-80a8-a90b9eb0ab51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:07.802962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d0477-8675-4ffd-80a8-a90b9eb0ab51 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:07.811862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 239/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:08.726278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaf124-b90d-4783-8d78-204c27189fb8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:08.726804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaf124-b90d-4783-8d78-204c27189fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:08.726804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaf124-b90d-4783-8d78-204c27189fb8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:08.728490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 242/481] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:08.742858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b259c-4f70-4c87-a53e-b9c68adae971 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:08.743351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b259c-4f70-4c87-a53e-b9c68adae971 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:08.743455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b259c-4f70-4c87-a53e-b9c68adae971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:08.748628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:08.769384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-307b259c-4f70-4c87-a53e-b9c68adae971 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:08.770576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-307b259c-4f70-4c87-a53e-b9c68adae971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:08.858286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 240/482] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:08.896963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaf124-b90d-4783-8d78-204c27189fb8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.017275 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaf124-b90d-4783-8d78-204c27189fb8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:09.042335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:09.064797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facba102-2d02-48af-9823-e78dfab6813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:09.065601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facba102-2d02-48af-9823-e78dfab6813e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.065885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facba102-2d02-48af-9823-e78dfab6813e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.066160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facba102-2d02-48af-9823-e78dfab6813e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.085059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facba102-2d02-48af-9823-e78dfab6813e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-facba102-2d02-48af-9823-e78dfab6813e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:09.092915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:09.095139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:09.097737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 243/483] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:09.104539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b259c-4f70-4c87-a53e-b9c68adae971 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.254712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b259c-4f70-4c87-a53e-b9c68adae971 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:09.272046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299692-ee63-4715-8cec-a39819fcd76d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.272411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299692-ee63-4715-8cec-a39819fcd76d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.272642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299692-ee63-4715-8cec-a39819fcd76d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.274288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 244/484] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:09.286111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cbdb-ae46-4099-8ca3-424b43e4b056 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.286406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cbdb-ae46-4099-8ca3-424b43e4b056 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.286687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cbdb-ae46-4099-8ca3-424b43e4b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.289903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:09.295710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:09.296670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.297156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.297638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.298665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:09.299791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:09.301475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:09.310815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 241/485] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:09.316435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.365228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-22c0cbdb-ae46-4099-8ca3-424b43e4b056 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:09.366446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-22c0cbdb-ae46-4099-8ca3-424b43e4b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:09.451111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee358857-b729-44f3-9583-8ddfb8aba492 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:09.466640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 245/486] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:59:09.488993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:09.489784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.490063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.490338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.501292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:09.502806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:09.511410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cbdb-ae46-4099-8ca3-424b43e4b056 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:09.541875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:09.542807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:09.543677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:09.543677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:09.543677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:09.543677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:09.547600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 242/487] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:09.550615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.648327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cbdb-ae46-4099-8ca3-424b43e4b056 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:09.656524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:09.668566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:09.683707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd90a4f-234f-44a0-b03d-43270b41e2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:09.684537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90a4f-234f-44a0-b03d-43270b41e2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.684816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90a4f-234f-44a0-b03d-43270b41e2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.685091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90a4f-234f-44a0-b03d-43270b41e2c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.695590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd90a4f-234f-44a0-b03d-43270b41e2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0bd90a4f-234f-44a0-b03d-43270b41e2c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:09.703357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:09.711614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 246/488] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:09.713782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1294eb-736a-495c-8331-e4b8398d43d0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.714522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1294eb-736a-495c-8331-e4b8398d43d0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.714522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1294eb-736a-495c-8331-e4b8398d43d0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.714522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 247/489] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:09.714522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1294eb-736a-495c-8331-e4b8398d43d0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.749474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4113cc-8cee-4f50-a0ad-63c5aa573260 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:09.797355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd84b8-3414-48f2-85ff-e4e9fc598c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:09.798701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd84b8-3414-48f2-85ff-e4e9fc598c96 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.799564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd84b8-3414-48f2-85ff-e4e9fc598c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.800353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd84b8-3414-48f2-85ff-e4e9fc598c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.801205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd84b8-3414-48f2-85ff-e4e9fc598c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:09.801628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd84b8-3414-48f2-85ff-e4e9fc598c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:09.803661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd84b8-3414-48f2-85ff-e4e9fc598c96 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:09.816763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 243/490] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:09.818240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0bd2-1a2f-4287-9907-d254087a88b5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.818727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0bd2-1a2f-4287-9907-d254087a88b5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.819168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0bd2-1a2f-4287-9907-d254087a88b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.827773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1294eb-736a-495c-8331-e4b8398d43d0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:09.838226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-94de0bd2-1a2f-4287-9907-d254087a88b5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:09.839634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94de0bd2-1a2f-4287-9907-d254087a88b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:09.876162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:09.877123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:09.878133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:09.878516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:09.879415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:09.880083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:09.882492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:09.893070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 248/491] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:09.894671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.919360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 244/492] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:09.920595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0bd2-1a2f-4287-9907-d254087a88b5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:09.948723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:09.976801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.041994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b190c-8d86-4663-b7e7-58594fdfa773 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.050518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0bd2-1a2f-4287-9907-d254087a88b5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.077581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.078390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.078674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.078995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.089823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.091271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.093702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96994814-06af-4713-95e0-919d6f03e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.095148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96994814-06af-4713-95e0-919d6f03e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.095630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96994814-06af-4713-95e0-919d6f03e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.096720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96994814-06af-4713-95e0-919d6f03e1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:10.107560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:10.108552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:10.109481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:10.110587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96994814-06af-4713-95e0-919d6f03e1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.110587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96994814-06af-4713-95e0-919d6f03e1b8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.112392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 249/493] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 07:59:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:10.113618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-96994814-06af-4713-95e0-919d6f03e1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:10.130842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:10.131855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:10.132770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:10.132770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:10.132770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:10.132770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:10.132770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 245/494] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:10.133421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a44a9-c1a9-4468-9220-2fddb739cedb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.133590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a44a9-c1a9-4468-9220-2fddb739cedb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.133889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a44a9-c1a9-4468-9220-2fddb739cedb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.138447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 246/495] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:10.138447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a44a9-c1a9-4468-9220-2fddb739cedb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.220635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.227189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.234053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60272-c5f8-4f77-9f7e-f514798ca536 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.241233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a44a9-c1a9-4468-9220-2fddb739cedb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.270950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.272009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.272328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.272611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.282291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d03997-a1be-43da-b4cb-1722a03be818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.283439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:10.284364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03997-a1be-43da-b4cb-1722a03be818 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.284928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03997-a1be-43da-b4cb-1722a03be818 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.285431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03997-a1be-43da-b4cb-1722a03be818 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.286478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d03997-a1be-43da-b4cb-1722a03be818 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:10.286989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d03997-a1be-43da-b4cb-1722a03be818 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.288680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d03997-a1be-43da-b4cb-1722a03be818 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:10.291944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:10.292883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 250/496] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:10.302714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.329969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 247/497] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:10.331132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0ed4-c3c4-40ed-8872-fa886868e252 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.331421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0ed4-c3c4-40ed-8872-fa886868e252 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.331698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0ed4-c3c4-40ed-8872-fa886868e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.349959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-136a0ed4-c3c4-40ed-8872-fa886868e252 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:10.351159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-136a0ed4-c3c4-40ed-8872-fa886868e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:10.411437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5d9c-c449-4976-a18c-c768e322fef8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.428230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 248/498] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:10.428230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a0ed4-c3c4-40ed-8872-fa886868e252 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.462163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.462841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.463127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.463513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.464982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:10.465869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.467607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.484955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:10.484955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.494680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.512796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.537675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a0ed4-c3c4-40ed-8872-fa886868e252 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.574781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.575367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.575644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.575916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.576706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:10.577008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.578378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.587274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 249/500] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:10.588059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.589787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7de0e-38f4-43c8-bdc2-9b8f8fed8572 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.623474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d610e41-029d-4aa7-a670-1ea4fc5413fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.624117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610e41-029d-4aa7-a670-1ea4fc5413fc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.624425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610e41-029d-4aa7-a670-1ea4fc5413fc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.624702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610e41-029d-4aa7-a670-1ea4fc5413fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.688284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac9437-c68d-46f8-bb6c-6e6d55be9f87 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.692695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d610e41-029d-4aa7-a670-1ea4fc5413fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.694157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d610e41-029d-4aa7-a670-1ea4fc5413fc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.703368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.722435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.723304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.723592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.723862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.730491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.734972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:10.742729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:10.743821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:10.744676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 250/501] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:10.746131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.794282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 252/502] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:10.795595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c002f-93b6-4464-aa44-c561ea37c5ad None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.795882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c002f-93b6-4464-aa44-c561ea37c5ad None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.796156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c002f-93b6-4464-aa44-c561ea37c5ad None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.797467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 253/503] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:10.798163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c002f-93b6-4464-aa44-c561ea37c5ad None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.847910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb368-6975-4e7c-a03a-9ae18f1e29eb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.881584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.882399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.882686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.882986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.890151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.891580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.898495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c002f-93b6-4464-aa44-c561ea37c5ad None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:10.907565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:10.908073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:10.909027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:10.909916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 251/504] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:10.910547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.932981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:10.933757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:10.934037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:10.934308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:10.944906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:10.946355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:10.964851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:10.965718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:10.966606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:10.966606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:10.966606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:10.966606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:10.966606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 254/505] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:10.966892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:10.976773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.018725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54fea-8e70-48f1-8788-62d8d8f16dbe None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.051891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790f3f5-fab4-48f1-a9de-161ab301b973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.052582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f3f5-fab4-48f1-a9de-161ab301b973 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.052871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f3f5-fab4-48f1-a9de-161ab301b973 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.053152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f3f5-fab4-48f1-a9de-161ab301b973 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.053923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790f3f5-fab4-48f1-a9de-161ab301b973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:11.054230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790f3f5-fab4-48f1-a9de-161ab301b973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.055610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790f3f5-fab4-48f1-a9de-161ab301b973 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.063426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 252/506] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:11.064347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f833137-7157-46c5-853e-e8643f3ee725 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.064735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265700cc-938a-4688-a839-4d2c69053db6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.065625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265700cc-938a-4688-a839-4d2c69053db6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.065907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265700cc-938a-4688-a839-4d2c69053db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.082669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-265700cc-938a-4688-a839-4d2c69053db6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:11.083854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-265700cc-938a-4688-a839-4d2c69053db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:11.100371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.101088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.101367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.101639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.111445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.113508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:11.131127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:11.132235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:11.133114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:11.133114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:11.133114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:11.133114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:11.133114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 255/507] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:11.133114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.148823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.154452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 253/508] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:11.155286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265700cc-938a-4688-a839-4d2c69053db6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.215104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.234020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d93444-7488-4467-9a41-0804eabe94da None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.265669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265700cc-938a-4688-a839-4d2c69053db6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.267897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.268601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.268884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.269161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.269992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:11.270303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.272017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.299939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.300689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.300974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.301315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.302044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:11.302347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.303720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.307717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 256/509] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:11.308575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.318268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 254/510] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:11.319078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.382323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.412056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a598-41e6-4af4-9408-ccfac729f88e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.420021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a848c-6fb0-4851-bd4d-484c324095fb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.430914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.446900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.447698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.447980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.448294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.453567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.454216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.454532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.454816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.455677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:11.455986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.457364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.458461 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.459935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.469333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 255/511] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:11.469871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:11.482399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:11.483309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:11.484220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:11.484220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:11.484220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:11.484220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:11.484220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 257/512] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:11.484495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.573148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a9b0-2da8-49f9-97ee-eb84fd5b6f3d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.585463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41ad0-1d85-435f-b6e6-7fd929fbb725 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.608097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.608854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.609644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.609929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.610206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.620075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.620807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.621030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.621150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.621357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.622558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:11.640775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:11.641814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:11.642944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:11.642944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:11.642944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:11.642944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:11.642944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:11.643338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.668460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.690114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.691580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.743687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523b33-71f9-4868-b8c8-2cd4d8536cd3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.777416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.778197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.778480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.778755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.786430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.787879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.789484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 258/514] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:11.790142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:11.803537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:11.804700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 257/515] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:11.805792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.815918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.885413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:11.890306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b44f6-8010-4251-bee6-1c8146d5d947 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.903805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534cf8b-5fdc-4528-bee7-71e60f846ee0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:11.925359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.926136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.926414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.926691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.933330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.934775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.938279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:11.938925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:11.939202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:11.939473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:11.940187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:11.940522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:11.941872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:11.949035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:11.949893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:11.950760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 259/516] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:11.951238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:11.957706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 258/517] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:11.958532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.031808 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.050497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18467374-5dda-45b3-802e-49eedc5b0698 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.057486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c79d0-7f04-440c-b891-ec4ad34a7de6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.083687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.084373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.084652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.084922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.085640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:12.085942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.087301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.090959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.091735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.092014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.092326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.098933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 260/518] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:12.099753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.103690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.105288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.107033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:12.123582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:12.124626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:12.125549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:12.125549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:12.125549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:12.125549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:12.125549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:12.125825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.204051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758392e2-c44a-4bf3-aad5-71e21f993732 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.227415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dedfd-09f8-4947-96b6-5d6cef9fa7f1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.238551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.239213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.239499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.239775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.240638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:12.240947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.242388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.256225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.259778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 261/520] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:12.260622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.260760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.261408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.261688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.261959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.262738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:12.263041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.264929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.283134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 260/521] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:12.284481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.342900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.361311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058e22-d267-4dd8-8e25-e2a2cf11bd30 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.389328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c6c42-7825-4ed5-9ff0-eb797e49da32 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.394824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.395611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.395895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.396456 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.403379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.404861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:12.420247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:12.421329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 262/522] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:12.422317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.427385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.428087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.428409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.428689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.429398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.430839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.479183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.517237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14569a-6a05-4ddd-8ae0-72c858ea80bc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.536937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 261/523] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:59:12 2022] POST /identity/v3/users => generated 247 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:12.537777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.555125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.555808 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.556091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.556424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.557139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:12.557459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.558899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.578058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 263/524] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:12.578058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.663298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e495f7-5eaf-427f-892f-915367946b75 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.674592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.688392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639c31e-082c-48f1-87d1-bd2df6131094 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.701047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.701700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.702180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.702463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.710526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.726347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.727029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.727395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.727677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.728545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7602c632829d44179aa129c552d1870a) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:12.728856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.730344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.736327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 264/525] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/role_assignments?user.id=7602c632829d44179aa129c552d1870a&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:12.737433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.794968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.796879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:12.920324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c4f3-31bd-4152-b7e7-8cf3401add09 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:12.956320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 262/526] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:12.957238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:12.969864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:12.983763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:12.983763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:12.983763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:12.983763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:12.985731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:12.986358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:12.989355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.016389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 265/527] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:13.016389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.071148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838c68f-1403-43e8-aec5-811b0039b39f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.104598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:13.113076 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:13.121184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:13.121184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:13.121184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:13.124457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:13.126522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.136678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f0e6-fe14-4d75-82bd-713e9bb22e52 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:13.147691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:13.148607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:13.149490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:13.150479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 263/528] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:13.151425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.177840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:13.178753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:13.179103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:13.179624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:13.192353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:13.193995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:13.214157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:13.215967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:13.218080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:13.218080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:13.218080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:13.218080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:13.218080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 266/529] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:13.218080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.239985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:13.275600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85d292-42aa-4cf7-92a8-54e26c4123b8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.312912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:13.313908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:13.314373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:13.314885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:13.339843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:13.349146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2a976-054a-41d5-bda4-64ff0a5f6695 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.394608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:13.396801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:13.397090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.397464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:13.397746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:13.398021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:13.398801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:13.399106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:13.400830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.424978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 267/530] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:13.425820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.475867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:13.515010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 264/531] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:13.515010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.567954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d886a-1b1a-47ad-a6a1-bf6c0e2eaa55 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.605741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:13.606443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:13.606736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:13.607018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:13.607827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:13.608046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:13.609700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.626157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 268/532] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:13.626157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.647593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:13.650298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbfb74-cc95-47b6-a6f0-96821ed66cff None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.690192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:13.691403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:13.691868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:13.692365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:13.693417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=d61999e7673a4a1cbc5ad487f8d16845) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:13.693910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:13.695805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.703090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 265/533] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/role_assignments?user.id=d61999e7673a4a1cbc5ad487f8d16845&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:13.704300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.751516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047d040-a839-4b45-bbf0-19969a46ad05 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.790473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:13.796385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:13.797290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:13.801742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:13.801742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:13.819376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:13.821072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:13.848122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:13.849083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:13.849972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:13.849972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:13.849972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:13.849972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:13.849972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 269/534] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:13.856144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:13.937259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7c3e0-c55b-400f-889d-f2c008a9abab None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:13.992598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:14.023690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b4bf-6a85-42ca-bfb0-511ac3fe0ff4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:14.032160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:14.033112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.033544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.034406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.052693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:14.054224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:14.062112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae475c-a822-495b-8988-30bd196179fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:14.063020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae475c-a822-495b-8988-30bd196179fd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.063499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae475c-a822-495b-8988-30bd196179fd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.063968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae475c-a822-495b-8988-30bd196179fd None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.064978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae475c-a822-495b-8988-30bd196179fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:14.068756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae475c-a822-495b-8988-30bd196179fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:14.070585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae475c-a822-495b-8988-30bd196179fd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:14.081818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:14.082763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:14.083619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:14.092064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 266/535] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:14.100422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 270/536] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:14.105905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:14.112771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae475c-a822-495b-8988-30bd196179fd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:14.280563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:14.283291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae475c-a822-495b-8988-30bd196179fd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:14.297847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c72f-aa55-45fd-ad8e-6c7bae7d4667 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:14.340650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:14.352987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:14.353655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.353936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.354353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.355331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:14.356553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:14.357958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:14.362917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:14.367768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.368279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.368795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.379620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:14.382136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 271/537] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:14.383917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:14.387642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:14.414677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:14.415586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:14.416499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:14.420393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 267/538] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:14.426286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:14.580241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b51e1-9e2e-42cc-9a4b-5560ced8a6c1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:14.594466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4dae-834b-4b77-81e2-aa5e725cea72 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:14.647531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:14.648203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.648623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.648897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.649736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=32681494192c4f6c9ba36d68e4b6399b) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:14.650048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:14.651484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:14.656797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be131-3dcf-4c30-92ed-da5fb1c12ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:14.657463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be131-3dcf-4c30-92ed-da5fb1c12ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.657744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be131-3dcf-4c30-92ed-da5fb1c12ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.658018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be131-3dcf-4c30-92ed-da5fb1c12ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.658899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be131-3dcf-4c30-92ed-da5fb1c12ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:14.659207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be131-3dcf-4c30-92ed-da5fb1c12ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:14.660652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be131-3dcf-4c30-92ed-da5fb1c12ca0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:14.672376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 272/539] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:14 2022] GET /identity/v3/role_assignments?user.id=32681494192c4f6c9ba36d68e4b6399b&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:14.682943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 268/540] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:14.706365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:14.773135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:14.815293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cd3c-be03-411f-82d3-d06ebacf4821 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.815588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cd3c-be03-411f-82d3-d06ebacf4821 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.815917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cd3c-be03-411f-82d3-d06ebacf4821 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.817551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 269/541] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:14.826447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090fac-1c35-420c-b255-fce0c4ea7161 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.826751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090fac-1c35-420c-b255-fce0c4ea7161 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.827036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090fac-1c35-420c-b255-fce0c4ea7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.852493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0d090fac-1c35-420c-b255-fce0c4ea7161 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:14.854674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0d090fac-1c35-420c-b255-fce0c4ea7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:14.871916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609414a-0084-4290-95f9-3bb1465192c5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:14.876582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:14.925032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:14.925720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:14.926009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:14.926287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:14.927129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=2d8183015eed4fd19e4a5fdf57d341e1) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:14.927443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:14.929464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:14.945245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 273/542] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:14 2022] GET /identity/v3/role_assignments?user.id=2d8183015eed4fd19e4a5fdf57d341e1&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:14.980266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 270/543] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:15.021731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:15.052227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd804ac1-1ec8-45b0-987c-2c9f8899af59 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:15.052776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd804ac1-1ec8-45b0-987c-2c9f8899af59 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:15.052776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd804ac1-1ec8-45b0-987c-2c9f8899af59 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:15.054203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 271/544] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:15.059872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86503ae-4fed-4fdb-b21b-908bad61a00a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:15.060240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86503ae-4fed-4fdb-b21b-908bad61a00a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:15.060593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86503ae-4fed-4fdb-b21b-908bad61a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:15.090604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e86503ae-4fed-4fdb-b21b-908bad61a00a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:15.091831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e86503ae-4fed-4fdb-b21b-908bad61a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:15.202226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2322e-a1fa-43f9-bd84-dcb7e4517250 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:15.217102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:15.225839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 272/545] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:15.238971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:15.239985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:15.240439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:15.240859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:15.252137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:15.260804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:15.261889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:15.262900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:15.266809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 274/546] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:15.272520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86503ae-4fed-4fdb-b21b-908bad61a00a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:15.277658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:15.414848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:15.450145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86503ae-4fed-4fdb-b21b-908bad61a00a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:15.475996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3430b8-3ed9-4752-97be-78df9d568cdd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:15.508343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:15.509031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:15.509322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:15.509597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:15.510364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:15.510670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:15.512063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:15.523130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:15.524367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:15.524860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:15.525349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:15.527645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 273/547] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:15.535473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:15.540782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:15.555324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:15.556568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:15.557651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 275/548] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:15.569570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:15.640567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:15.732796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357cb8-dddf-4be8-b848-632a77c97df9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:15.770587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce37be-bf81-4c4f-8feb-c504b933520c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:15.804479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:15.805277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:15.805557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:15.805834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:15.820528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:15.824953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:15.826524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:15.838230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:15.838913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:15.839199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:15.839475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:15.840261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:15.840573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:15.842006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:15.859651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 276/549] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:15.866221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:15.867077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:15.868139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:15.868139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:15.868139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:15.868139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:15.868139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 274/550] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:15.873356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:15.879063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.024906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:16.034685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3147a9-d59d-400d-9978-659b556816dd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.057019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da592d-46aa-4bb0-a206-97a369cf8b6b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.070984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8bfb1-32f9-4b3d-b354-430099effb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.071920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8bfb1-32f9-4b3d-b354-430099effb85 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.072208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8bfb1-32f9-4b3d-b354-430099effb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.072511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8bfb1-32f9-4b3d-b354-430099effb85 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.073391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8bfb1-32f9-4b3d-b354-430099effb85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:16.073699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8bfb1-32f9-4b3d-b354-430099effb85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.075726 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8bfb1-32f9-4b3d-b354-430099effb85 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.091538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 277/551] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:16.093498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe4c4-2c20-4f98-b95f-7d707b1f3d70 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.093880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe4c4-2c20-4f98-b95f-7d707b1f3d70 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.094164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe4c4-2c20-4f98-b95f-7d707b1f3d70 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.096265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 278/552] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:16.097219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe4c4-2c20-4f98-b95f-7d707b1f3d70 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.101159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b527-1a92-499a-aa67-55566e74bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.102822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b527-1a92-499a-aa67-55566e74bc9f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.103116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b527-1a92-499a-aa67-55566e74bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.103396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b527-1a92-499a-aa67-55566e74bc9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.116923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b527-1a92-499a-aa67-55566e74bc9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.118817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b527-1a92-499a-aa67-55566e74bc9f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-54c5b527-1a92-499a-aa67-55566e74bc9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:16.140765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:16.141680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:16.143886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:16.143886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:16.143886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:16.143886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:16.143886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 275/553] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:16.144457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9bb2-802c-4221-a074-bd7d4ef12030 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.144457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9bb2-802c-4221-a074-bd7d4ef12030 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.144652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9bb2-802c-4221-a074-bd7d4ef12030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.166497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-372f9bb2-802c-4221-a074-bd7d4ef12030 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:16.167852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-372f9bb2-802c-4221-a074-bd7d4ef12030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:16.208633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:16.218701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe4c4-2c20-4f98-b95f-7d707b1f3d70 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.248233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 276/554] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:16.248233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f9bb2-802c-4221-a074-bd7d4ef12030 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.272913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.274087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.274702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.283580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.291808 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.293629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:16.311574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:16.316182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 279/555] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:16.317340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.337485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:16.357051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f9bb2-802c-4221-a074-bd7d4ef12030 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.396180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.397121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.397403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.397701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.398605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:16.398800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.400165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.412633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 277/556] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:16.417894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.430699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f34f4-7a2a-4e4f-972d-5f95db379b78 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.452585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:16.470358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.471538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.471970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.476601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.486058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:16.494595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:16.495774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:16.497162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:16.505123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 280/557] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:16.506748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.527112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05535f7-2f28-4af6-b374-59f77fc9688f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.572556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.573229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.573428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.573735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.574529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:16.574937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.582339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.593216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:16.602858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 278/558] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:16.603886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.618245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d64f0e-6cc2-4031-a752-dc1ce869d984 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.655806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.656959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.657095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.657266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.666292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.667898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:16.684308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:16.685285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:16.686322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:16.692236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 281/559] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:16.692236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.709850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:16.726251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904f1fb-bff5-45d5-bca1-d8cdf57a2c45 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.769901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.771608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.772080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.772554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.773920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:16.774373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.776124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.792602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 279/560] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:16.793272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:16.821519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b4b4-f577-4217-a8f4-adfa54f5a384 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.858775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92647ad-dffd-437c-a232-678fa426a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.859343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92647ad-dffd-437c-a232-678fa426a50f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.859622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92647ad-dffd-437c-a232-678fa426a50f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.859894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92647ad-dffd-437c-a232-678fa426a50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.865759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:16.929068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48051-6f22-497a-9bb9-8c0e4315c910 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:16.947302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92647ad-dffd-437c-a232-678fa426a50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.949080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92647ad-dffd-437c-a232-678fa426a50f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.964921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:16.965589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:16.965870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:16.966250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:16.967083 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:16.967492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:16.968825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:16.993321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 280/561] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:16.994006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.005268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.064645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 282/562] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:17.066896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef623b8b-ba37-4f57-bea8-5f4342386575 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.067346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef623b8b-ba37-4f57-bea8-5f4342386575 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.067715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef623b8b-ba37-4f57-bea8-5f4342386575 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.073614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 283/563] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:17.073614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef623b8b-ba37-4f57-bea8-5f4342386575 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.107482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a890-b648-4a13-b13e-c5238db56788 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.118089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.145476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.146528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.146816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.147094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.157532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.159572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:17.178053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:17.179174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:17.180080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:17.180080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:17.180080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:17.180080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:17.180080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 281/564] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:17.180080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.198693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef623b8b-ba37-4f57-bea8-5f4342386575 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.241174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eb09c-d393-492e-a49d-a1b5777115c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.241958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eb09c-d393-492e-a49d-a1b5777115c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.242234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eb09c-d393-492e-a49d-a1b5777115c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.242634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eb09c-d393-492e-a49d-a1b5777115c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.242746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.252953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eb09c-d393-492e-a49d-a1b5777115c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.254370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eb09c-d393-492e-a49d-a1b5777115c3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d58eb09c-d393-492e-a49d-a1b5777115c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:17.272710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:17.279990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 284/565] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c38596-b027-4084-9715-a5abe648eca4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c38596-b027-4084-9715-a5abe648eca4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.280923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c38596-b027-4084-9715-a5abe648eca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.288217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801f643-2793-4bd4-a121-34f063ef9ce4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.292177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f1c38596-b027-4084-9715-a5abe648eca4 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:17.293397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f1c38596-b027-4084-9715-a5abe648eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:17.323681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.324506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.324786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.325058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.335666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.337236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:17.355329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:17.356247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:17.357187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:17.357187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:17.357187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:17.357187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:17.357187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 282/566] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:17.357503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.365364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 285/567] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:17.367252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651702-0d79-474d-9dcf-8d806589eb56 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.367545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651702-0d79-474d-9dcf-8d806589eb56 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.368273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651702-0d79-474d-9dcf-8d806589eb56 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.372230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 286/568] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:17.372230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13651702-0d79-474d-9dcf-8d806589eb56 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.397179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.460304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7af58-824d-43b5-85c1-2ec6ab02d882 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.473493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.478836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13651702-0d79-474d-9dcf-8d806589eb56 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.495955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.496722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.497006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.497281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.498002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:17.498343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.499702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.511526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 283/569] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:17.512473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.514607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f7c4d-67bf-48cd-8afd-41db7b4858a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.515335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7c4d-67bf-48cd-8afd-41db7b4858a3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.515612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7c4d-67bf-48cd-8afd-41db7b4858a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.515903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7c4d-67bf-48cd-8afd-41db7b4858a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.516639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7c4d-67bf-48cd-8afd-41db7b4858a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:17.516944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7c4d-67bf-48cd-8afd-41db7b4858a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.519007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7c4d-67bf-48cd-8afd-41db7b4858a3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.530689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 287/570] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:17.531893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d55e1-acf3-4aa3-b0cc-87f299a88ed1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.532182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d55e1-acf3-4aa3-b0cc-87f299a88ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.532490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d55e1-acf3-4aa3-b0cc-87f299a88ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.549813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d41d55e1-acf3-4aa3-b0cc-87f299a88ed1 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:17.551007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d41d55e1-acf3-4aa3-b0cc-87f299a88ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:17.618209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 288/571] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:17.619119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d55e1-acf3-4aa3-b0cc-87f299a88ed1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.624223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d08195-1751-49e9-a926-2dd083ba8390 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.629484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.661311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.662014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.662294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.662566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.663286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:17.663586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.664960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.677198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 284/572] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:17.678022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.708022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.725758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d55e1-acf3-4aa3-b0cc-87f299a88ed1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.759399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.760229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.760517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.760794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.771576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:17.776879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d17f7-f2f4-44a4-bc4e-ffd30db95b00 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:17.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:17.780242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:17.781201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 289/573] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:17.781903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.815874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.816712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.816995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.817268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.824323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.825754 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:17.840927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:17.841956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 285/574] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:17.842924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.851593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.884964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce83d-7aa8-4956-b2d2-9cbb70035f55 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.918428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.919296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.919583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.919854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.926496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:17.927936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:17.934967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:17.941722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:17.960344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 290/575] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:17.961314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:17.961875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d129-e721-4ec9-981f-430b941c585e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:17.977995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:17.978806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:17.979083 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:17.979361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:17.990858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:17.998352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:17.999303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:18.000135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 286/576] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:18.000892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.047938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d4e5-ccbe-4a47-b1ad-6a7fd0cd90a9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.073392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.081656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.082534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.082800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.083073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.089595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.091018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.105108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a9c3-274f-4f90-a57e-9eacdcf21337 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:18.105250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:18.106240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:18.107269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 291/577] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:18.107948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.144541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.145129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.145410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.145685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.146694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:18.146998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.148383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.160525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 287/578] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:18.160525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.175572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.208993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa06863-5c75-4129-8fca-7d25cd384975 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.241404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.242053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.242337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.242643 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.243507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:18.243820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.245294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.258562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c2240-643f-4701-9320-b1a45bdf28a1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.262869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 292/579] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:18.263667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.293221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.294128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.294412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.294686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.295468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:18.295837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.297309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.309253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 288/580] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:18.310033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.321801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.374690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00178-1bcd-4585-b6ca-2f6304322aec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.383503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.409637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8902-38c8-4f29-b224-f5eab6096195 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.410639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.411298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.411581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.411854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.412658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:18.412941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.414301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.426966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 293/581] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:18.426966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.445345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.445991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.446275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.446552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.447328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:18.447636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.449077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.461418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 289/582] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:18.462051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.522888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3d2b1-697b-4c85-bf7e-7abb3fe0a3ad None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.531375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.556935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.557716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.557995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.558268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.562003 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e8606-d18f-4fb4-85c4-4d12c7c98d5c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.570626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.572062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:18.589578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:18.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:18.591568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:18.591568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:18.591568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:18.591568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:18.591568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 294/583] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:18.591568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.602350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.603206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.603516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.603789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.605729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.615084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.618874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:18.634929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:18.635961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:18.637228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:18.637228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:18.637228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:18.637228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:18.637228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 290/584] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:18.637228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.693600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8e44-6874-4bf8-b35d-81b4fb0704c5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.726993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.727885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.728163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.728471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/7602c632829d44179aa129c552d1870a/roles/f40fb8f3b0f14a92a30b875528b909f4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.738309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23cb1-14f2-4f44-a545-4117d68ca3ac None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.743731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=7602c632829d44179aa129c552d1870a, role_id=f40fb8f3b0f14a92a30b875528b909f4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.745221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.771236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.772299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.772580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.772850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.784068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.785524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:18.803128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:18.804162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:18.805456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:18.805456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:18.805456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:18.805456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:18.805456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 291/585] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:18.805456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.845236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.851804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 295/586] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:18 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/7602c632829d44179aa129c552d1870a/roles/f40fb8f3b0f14a92a30b875528b909f4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:18.852650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.874561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:18.917874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58860f56-3a55-42a1-8110-f8fe6730c706 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:18.958420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:18.959025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:18.959314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:18.959593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:18.960470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7277ec365bac4e9d8a22f63c55bbb908) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:18.960785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:18.962311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:18.968629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 292/587] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/role_assignments?user.id=7277ec365bac4e9d8a22f63c55bbb908&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:18.969484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:18.985612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcee822-bfde-4432-822e-6a0bab9c528d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.032682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.034132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.035235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.035509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.037161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:19.037491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.038923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.054558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 296/588] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:19.055439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.130240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227476-b474-4b7c-a527-9c9cda44dc98 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.132324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.144877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.168469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.169738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.170173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.170600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.171486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:19.171941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.173497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.181767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d947a-bdf4-4e5c-9129-b0ee2894af8a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.188017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 293/589] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:19.189189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.218817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.219460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.219771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.220093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.220803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:19.222013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.223716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.238112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 297/590] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:19.239083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.302134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7771e35-0473-45d9-88f3-3e8942540a0f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.341274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.342429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.342931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.343762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.348080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484866cd-3763-46d1-9ea6-dce9f3266859 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.353036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.354703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:19.370564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:19.371548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 07:59:19.372542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:19.379746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 294/591] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:19.380571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.382137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.386856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.388021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.388021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.388292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.397019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.398545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:19.413904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:19.414844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:19.415743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 298/592] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:19.416250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.436553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.496601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff4a8f-823f-4c19-8cad-968260c74d1f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.525312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc1592-94a6-49f7-8441-4abf88f203d7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.535082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.536303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.536900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.537371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.545460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.547220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.561067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.561734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.562014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.562290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.563121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:19.563429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.568132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:19.570763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:19.571678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 07:59:19.572681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:19.574994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 295/593] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:19.579191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.594696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 299/594] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:19.594696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.648553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.679444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.698692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156e8d7-3812-4094-bbf7-6e1bacb6745e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.701844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee9f6a-3349-4208-9f7b-56f468dc272f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.738262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.739203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.739465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.739951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.740144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.740536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.740649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.740999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.741735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:19.742016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:19.742342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.742547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.744053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.744170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.757584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 296/595] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:19.758620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.763928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 300/596] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:19.764546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:19.870385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaef3fb-3292-4f0b-99ea-8fbb026f791c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.872013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a5394-a6b9-4a93-bad0-c533f946f5c8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:19.878628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.906717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.907742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.908122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.909066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/d61999e7673a4a1cbc5ad487f8d16845/roles/f40fb8f3b0f14a92a30b875528b909f4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.910755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:19.911814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:19.912265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:19.912736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:19.924822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.925854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=d61999e7673a4a1cbc5ad487f8d16845, role_id=f40fb8f3b0f14a92a30b875528b909f4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:19.926888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.927498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:19.929047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:19.946543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:19.954858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:19.956449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:19.956449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:19.956449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:19.956449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:19.956449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 297/597] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:19.956449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.035978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 301/598] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:19 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/d61999e7673a4a1cbc5ad487f8d16845/roles/f40fb8f3b0f14a92a30b875528b909f4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:20.037505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.086418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d44de-ca94-4a7b-ba0d-46434ab09a85 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.137911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:20.138783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:20.139070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:20.139402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:20.163072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:20.164581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:20.187172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e956d-ccd3-4913-b017-e2246a652498 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:20.194493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:20.195787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:20.196741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:20.196741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:20.196741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:20.196741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:20.196741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 298/599] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:20.206027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.228299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:20.228980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:20.229265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:20.229542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:20.230280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:20.230587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:20.231965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:20.245344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 302/600] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:20.250988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.273077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:20.273980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:20.359507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40495185-ddf5-4f89-9d7f-9e5174cc7392 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.368580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd874d8-6d08-4f85-8a28-a898a43901ea None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.395730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:20.396823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:20.397109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:20.397679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:20.405090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:20.406861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:20.428102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:20.429081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:20.429967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 303/601] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:20.434948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.452165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:20.452860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:20.453143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:20.453424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:20.454155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:20.454461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:20.456455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:20.481528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 299/602] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:20.486621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.539331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:20.565607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fa24a-975f-42f6-aa81-f60ecfa5e07e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.605388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:20.606055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:20.606342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:20.606623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:20.607414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:20.607727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:20.609225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:20.623622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 304/603] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:20.633203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.701362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb90a1e-043f-4a57-ab98-1e584f6f26b4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.732553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:20.738222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d223ac-394f-46c0-8eda-47fd5e7a3d51 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.767486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:20.768386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:20.768900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:20.768900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:20.784344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:20.785551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:20.794839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5c8d8-b5af-4d4c-b044-3b267843ca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:20.795741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c8d8-b5af-4d4c-b044-3b267843ca83 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:20.796126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c8d8-b5af-4d4c-b044-3b267843ca83 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:20.796430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c8d8-b5af-4d4c-b044-3b267843ca83 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/32681494192c4f6c9ba36d68e4b6399b/roles/f40fb8f3b0f14a92a30b875528b909f4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:20.804535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:20.819289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:20.822577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:20.823473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 300/604] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:20.828661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:20.829533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5c8d8-b5af-4d4c-b044-3b267843ca83 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=32681494192c4f6c9ba36d68e4b6399b, role_id=f40fb8f3b0f14a92a30b875528b909f4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:20.831236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5c8d8-b5af-4d4c-b044-3b267843ca83 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:20.945294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201406b-dc5c-42bb-a820-63670502c86e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:20.954182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 305/605] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:20 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/32681494192c4f6c9ba36d68e4b6399b/roles/f40fb8f3b0f14a92a30b875528b909f4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:21.006039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:21.006804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.007136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.007419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.008320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:21.008635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:21.010220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:21.032142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 301/606] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:21.034271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3a21a-3dfe-46fa-8d8e-c89f7009c501 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.034520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3a21a-3dfe-46fa-8d8e-c89f7009c501 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.034805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3a21a-3dfe-46fa-8d8e-c89f7009c501 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.036247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 306/607] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:21.037915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:21.051964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf89d-3035-4ddb-91bd-24f68aa5c626 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.052309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf89d-3035-4ddb-91bd-24f68aa5c626 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.052550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf89d-3035-4ddb-91bd-24f68aa5c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.084599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:21.089015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a54bf89d-3035-4ddb-91bd-24f68aa5c626 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:21.090262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a54bf89d-3035-4ddb-91bd-24f68aa5c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:21.192635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb06a-109e-4148-a5a9-d2a4fffbfb44 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:21.196733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 307/608] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:59:21.222207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bf89d-3035-4ddb-91bd-24f68aa5c626 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:21.240461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fc6c-4543-467d-b81c-7abdc921a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:21.242063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fc6c-4543-467d-b81c-7abdc921a8cf None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.242578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fc6c-4543-467d-b81c-7abdc921a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.244668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fc6c-4543-467d-b81c-7abdc921a8cf None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/2d8183015eed4fd19e4a5fdf57d341e1/roles/f40fb8f3b0f14a92a30b875528b909f4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.262406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0fc6c-4543-467d-b81c-7abdc921a8cf None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=2d8183015eed4fd19e4a5fdf57d341e1, role_id=f40fb8f3b0f14a92a30b875528b909f4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:21.264509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0fc6c-4543-467d-b81c-7abdc921a8cf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:21.336433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bf89d-3035-4ddb-91bd-24f68aa5c626 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:21.354612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 302/609] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:21 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/2d8183015eed4fd19e4a5fdf57d341e1/roles/f40fb8f3b0f14a92a30b875528b909f4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:21.355265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:21.379110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf5473-ae36-46c0-9463-1be77d13f468 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.379728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf5473-ae36-46c0-9463-1be77d13f468 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.380109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf5473-ae36-46c0-9463-1be77d13f468 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.382338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 303/610] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:21.387291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:21.388121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa0605-03a8-41e3-9a43-17e50f8fc6bc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.388255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.388425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.388519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa0605-03a8-41e3-9a43-17e50f8fc6bc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.388697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.388813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa0605-03a8-41e3-9a43-17e50f8fc6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.411538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:21.421179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:21.422201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:21.423499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 308/611] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:21.431594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:21.435986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-00fa0605-03a8-41e3-9a43-17e50f8fc6bc None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:21.437223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-00fa0605-03a8-41e3-9a43-17e50f8fc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:21.566215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 304/612] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:59:21.599305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa0605-03a8-41e3-9a43-17e50f8fc6bc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:21.603734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ceba3-b839-456a-aff5-e468b882d689 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:21.608583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:21.649797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:21.650234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.650517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.650793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.651635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:21.651849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:21.653277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:21.663344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 309/613] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:21.679931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:21.716873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa0605-03a8-41e3-9a43-17e50f8fc6bc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:21.755598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:21.756744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.757268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.757717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:21.759882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:21.774057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:21.782763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:21.784454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:21.785338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:21.788400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 305/614] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:21.794271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:21.896375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b5d77-da67-4051-a804-80aaa80301eb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:21.922199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:21.963915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d156c1-d56b-43c9-8ef3-9d3f3dc80a9c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:21.979151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:21.980152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:21.980365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:21.980642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.001302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.003535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.003852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:22.004823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.005484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.006135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.007615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:22.008339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.010119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.024267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 306/615] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:22.029874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:22.037984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:22.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:22.039789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:22.039789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:22.039789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:22.039789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:22.039789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 310/616] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:22.046562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:22.152842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1c0a8-9c24-4ecd-93af-ba39d0c60e3d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:22.188186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:22.203047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:22.204213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:22.205058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.205463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.207032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.224920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23497b-b3fb-4696-80d3-db9b7da10865 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:22.231685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.233189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:22.274808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:22.276225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:22.277142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:22.277142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:22.277142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:22.277142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:22.277142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 307/617] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:22.282402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:22.356931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:22.357618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.357903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.358181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.358921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:22.359218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.360624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.394766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 311/618] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:22.395891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b72b3-91ab-4f47-af20-e6528cbbee11 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:22.401697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:22.438198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:22.439024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.439304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.439579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.441001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:22.441305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.442659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.456189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 308/619] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:22.461373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:22.516513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:22.579906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8cc9-691d-401d-ab5e-7879ae32dfdd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:22.619539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:22.620349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.620631 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.620904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.639180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.640657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.672997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872e1f0-3885-4e55-8a9c-802db4f24cae None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:22.685204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:22.686179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:22.687150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 312/620] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:22.695520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:22.723671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:22.724483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.724762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.725038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.725908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:22.744978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.746431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:22.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:22.769790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:22.770769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 309/621] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:22.776085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:22.886887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:22.890151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3de1fa-44de-4182-9bf5-e0dacc0c1dec None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:22.940983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf7ea9-ece3-46d2-bc61-6cfa8bd98587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:22.941646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf7ea9-ece3-46d2-bc61-6cfa8bd98587 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.941925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf7ea9-ece3-46d2-bc61-6cfa8bd98587 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.942198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf7ea9-ece3-46d2-bc61-6cfa8bd98587 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.943150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf7ea9-ece3-46d2-bc61-6cfa8bd98587 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:22.943459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf7ea9-ece3-46d2-bc61-6cfa8bd98587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:22.945068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf7ea9-ece3-46d2-bc61-6cfa8bd98587 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:22.964296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b87f11-41f7-4591-b49a-5b67bc3685d6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:22.967432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 310/622] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:22.968773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ef3c-c895-4884-85a7-f5bb180270d0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:22.969056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ef3c-c895-4884-85a7-f5bb180270d0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:22.969326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ef3c-c895-4884-85a7-f5bb180270d0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:22.970536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 311/623] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:22.977083 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ef3c-c895-4884-85a7-f5bb180270d0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.005026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f766c9-d93f-4217-abc7-6165b79e69f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.005735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f766c9-d93f-4217-abc7-6165b79e69f1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.006020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f766c9-d93f-4217-abc7-6165b79e69f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.006292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f766c9-d93f-4217-abc7-6165b79e69f1 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.007123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f766c9-d93f-4217-abc7-6165b79e69f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:23.007428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f766c9-d93f-4217-abc7-6165b79e69f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:23.008901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f766c9-d93f-4217-abc7-6165b79e69f1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:23.032157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 313/624] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:23.033538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8a61e-4607-4ccb-9b93-c55058cdc28a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.034903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8a61e-4607-4ccb-9b93-c55058cdc28a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.035189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8a61e-4607-4ccb-9b93-c55058cdc28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.052341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e2a8a61e-4607-4ccb-9b93-c55058cdc28a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:23.053520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e2a8a61e-4607-4ccb-9b93-c55058cdc28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:23.108229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ef3c-c895-4884-85a7-f5bb180270d0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.120029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.132246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 314/625] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:23.133328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8a61e-4607-4ccb-9b93-c55058cdc28a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.143524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.144500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.144779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.145048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.157514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:23.160050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:23.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:23.184327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:23.185657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:23.185657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:23.185657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:23.185657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:23.185657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 312/626] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:23.185657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.204907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.286403 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8a61e-4607-4ccb-9b93-c55058cdc28a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.308030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a01157-9dc1-4232-92bd-68845d0b34c3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.325622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.326694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.327171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.327653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.352307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.353156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.353438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.353710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.368467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:23.378661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:23.379640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:23.380505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:23.384374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 313/627] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:23.386272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.412730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.416924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:23.418378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:23.478512 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.512381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9f79-9662-48e6-a726-6452a5882cc3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.532295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 315/628] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:23.534455 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.554013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9ac97-5922-413e-a391-6951a54e52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.554926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ac97-5922-413e-a391-6951a54e52fb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.555385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ac97-5922-413e-a391-6951a54e52fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.555834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ac97-5922-413e-a391-6951a54e52fb None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.556776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9ac97-5922-413e-a391-6951a54e52fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:23.557260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9ac97-5922-413e-a391-6951a54e52fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:23.558610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9ac97-5922-413e-a391-6951a54e52fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:23.574103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 314/629] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:23.575605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b429-4d77-4378-9af6-67abca3bbe60 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.575892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b429-4d77-4378-9af6-67abca3bbe60 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.576169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b429-4d77-4378-9af6-67abca3bbe60 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.580394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 315/630] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:23.581899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69b429-4d77-4378-9af6-67abca3bbe60 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.655268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.659446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec74e-ef39-4ec4-9dc5-82f84036d9b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.691503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69b429-4d77-4378-9af6-67abca3bbe60 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.693749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.694420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.694701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.694979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.695730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:23.696052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:23.697750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:23.711292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 316/631] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:23.711292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.728367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.734204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49073a73-c07b-4030-b241-124d11a13c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.735007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49073a73-c07b-4030-b241-124d11a13c1c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.735265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49073a73-c07b-4030-b241-124d11a13c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.739439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49073a73-c07b-4030-b241-124d11a13c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.746211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49073a73-c07b-4030-b241-124d11a13c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:23.747574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49073a73-c07b-4030-b241-124d11a13c1c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-49073a73-c07b-4030-b241-124d11a13c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:23.766017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:23.767016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:23.768507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:23.768507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:23.768507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:23.768507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:23.768507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 316/632] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:23.769852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb39ab-e575-44b4-b055-90443c8d24f0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.769852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb39ab-e575-44b4-b055-90443c8d24f0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.770372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb39ab-e575-44b4-b055-90443c8d24f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.788648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1ebb39ab-e575-44b4-b055-90443c8d24f0 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:23.789823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1ebb39ab-e575-44b4-b055-90443c8d24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:23.817575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d1428-0cd0-4e69-b7b2-9cea8ec4f8dd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.852708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12332b4-26cb-484a-a4d7-9b11163b7d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:23.853614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12332b4-26cb-484a-a4d7-9b11163b7d5b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.853905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12332b4-26cb-484a-a4d7-9b11163b7d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.854185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12332b4-26cb-484a-a4d7-9b11163b7d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.860871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12332b4-26cb-484a-a4d7-9b11163b7d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:23.862571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12332b4-26cb-484a-a4d7-9b11163b7d5b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:23.863548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 317/633] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:23.864477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb39ab-e575-44b4-b055-90443c8d24f0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b12332b4-26cb-484a-a4d7-9b11163b7d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:23.882267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:23.883208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:23.884138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 317/634] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:23.885149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9b7c-6520-44da-8058-288f80b0b563 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:23.885390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9b7c-6520-44da-8058-288f80b0b563 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:23.885905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9b7c-6520-44da-8058-288f80b0b563 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:23.887054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 318/635] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:23.887901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f9b7c-6520-44da-8058-288f80b0b563 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:23.911607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.968250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb39ab-e575-44b4-b055-90443c8d24f0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:23.981699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:23.991466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f9b7c-6520-44da-8058-288f80b0b563 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.001872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.002686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.002955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.003222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.013019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.014479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.025461 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.026111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.026395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.026668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.027382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:24.027689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.029072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:24.032900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:24.034386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:24.035299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:24.035299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:24.035299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:24.035299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:24.040144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 318/636] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:24.040144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.041378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 319/637] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:24.042256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.128076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:24.135564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7625aba-586f-47f5-a75a-46db3f7ac67f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.147606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3b159-fe63-4bfd-b241-ffc9d6dd95a8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.170276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede7396-4eed-406f-9704-6f1260c4cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.171065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7396-4eed-406f-9704-6f1260c4cd73 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.171346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7396-4eed-406f-9704-6f1260c4cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.171628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7396-4eed-406f-9704-6f1260c4cd73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.181172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.181661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede7396-4eed-406f-9704-6f1260c4cd73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:24.181827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.182113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.182394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.183188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:24.183501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.184952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3ede7396-4eed-406f-9704-6f1260c4cd73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:24.189371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:24.190881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:24.191728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 319/638] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:24.192476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13986d8-d130-431b-865f-29af672cea84 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.192662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13986d8-d130-431b-865f-29af672cea84 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.193158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13986d8-d130-431b-865f-29af672cea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.201375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 320/639] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:24.202128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.211832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a13986d8-d130-431b-865f-29af672cea84 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:24.213063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a13986d8-d130-431b-865f-29af672cea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:24.230535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:24.279632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 320/640] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:24.280689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13986d8-d130-431b-865f-29af672cea84 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.310995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6ca0c-8477-400d-b57e-80cb41a3d80d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.345374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.346051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.346336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.346613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.347324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:24.347631 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.349020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.357420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:24.360617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 321/641] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:24.361396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.379127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13986d8-d130-431b-865f-29af672cea84 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.414897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.415680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.415961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.416256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.423128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.424647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:24.437994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:24.438951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 321/642] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:24.440939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.458727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:24.464827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aab6a-f431-4483-b9f5-aed734f0e73b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.497835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.498494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.498773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.499046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.499782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:24.500091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.501477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.509721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 322/643] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:24.510491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.546957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ef34-4c53-409e-8345-b987b7d516db None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.574487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:24.584918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.584918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.584918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.584918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/7277ec365bac4e9d8a22f63c55bbb908/roles/f40fb8f3b0f14a92a30b875528b909f4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.598395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=7277ec365bac4e9d8a22f63c55bbb908, role_id=f40fb8f3b0f14a92a30b875528b909f4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.599822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.616946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc87c3c-cbaf-422e-96a0-cd0506d64315 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.649610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.650408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.650693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.650971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.660866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:24.668575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:24.669599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 323/644] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:24.670585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.676283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 322/645] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:24 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/7277ec365bac4e9d8a22f63c55bbb908/roles/f40fb8f3b0f14a92a30b875528b909f4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:24.677123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.758653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:24.800954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fb5dc-074c-46ce-bb94-711fde9fa074 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.801383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2455-0059-44ee-9815-91d93fcd5ef4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.827134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:24.839468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.840295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.840594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.840878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.847802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:24.848556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:24.848885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:24.849163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:24.849537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.849949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:24.850254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:24.850998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.851659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:24.866991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 323/646] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:24.867195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:24.868876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 07:59:24.869903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:24.870482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.870561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 324/647] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:24.870561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:24.976936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd547-b066-4c9b-a519-e208cc382a24 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:24.986483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea493e7-a1de-412e-a915-3c5ca1ed674f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.001404 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.014611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.015552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.015865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.016137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.024325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.025003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.025680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.025966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.027016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:25.027325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.027427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.028729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.028841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.038758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 325/648] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:25.041065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:25.049849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:25.051192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:25.052105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:25.052105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:25.052105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:25.052105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:25.052956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 324/649] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:25.053770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.093921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.151704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6758-93b3-4a51-b3f7-00a4c2029afb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.161800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc2ae7-9c72-41e3-8454-68beb5c87d8d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.189404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.190806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.191224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.191505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.192628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:25.193351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.195381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.197673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.198329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.198616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.198890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.199724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7602c632829d44179aa129c552d1870a) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:25.200034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.201482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.207958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 325/650] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/role_assignments?user.id=7602c632829d44179aa129c552d1870a&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:25.208533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.219502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 326/651] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:25.220694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.274451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.338768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a2bd1-ff0b-4497-9521-f637db5e227a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.350593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b13d5c-8208-4f65-b5bb-838b86b84266 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.353012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.384112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.386964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.386964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.386964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.401920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.402753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.403443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.403544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.403731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.404008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.404771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:25.405078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.406428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.420397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 327/652] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:25.421318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:25.422616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:25.423504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:25.424784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:25.424784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:25.424784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:25.424784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:25.424784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 326/653] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:25.428864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.543554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.551650 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8119406-1a40-4700-b8bc-05b13dbf1092 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.564258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5157d54-1c19-45da-85ef-77aafdefb08e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.597953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.599198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.599487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.599765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.607874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.608910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.609037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.609504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.609974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.610578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:25.629730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:25.630721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:25.631660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 327/654] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:25.632303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.652670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.706447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.708645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.751764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199e536-22b3-40ef-af1c-4c5de2301a37 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.800457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.801421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.802263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.802846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:25.803900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:25.804391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:25.806708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:25.825121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 328/655] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:25.826234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.832875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 328/656] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:25.833968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:25.844439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.936668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:25.955185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84587-c9af-4960-8311-71f1f7bcda1d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.956958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8aadb-0ee5-4cbc-8a51-0ab4fe8c4d6d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:25.998226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:25.999112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:25.999394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:25.999667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.000022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.000927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.001546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.002040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.004129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:26.004683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.006298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.007546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.009188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.026865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 329/657] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:26.027056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:26.027931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:26.029249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 329/658] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:26.029875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.031808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.114375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:26.156602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607b3c6-5418-4552-8c65-ca7f2b45965f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.158042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc43b5-3e38-427e-9fce-6be5b3ed5c2b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.182746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:26.195722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.196842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.197347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.197842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.203792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.204473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.204757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.205036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.209943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.211952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:26.230471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:26.231398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:26.232718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:26.232718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:26.232718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:26.232718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:26.234319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 330/659] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:26.235296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.300038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.302286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.348856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb73e3-b472-4eef-af05-4386facbda91 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.387240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.388754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.389310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.389821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.390876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:26.391396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.393085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.397167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:26.412898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 331/660] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:26.413752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.446984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 330/661] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:59:26.446984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.452802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:26.545337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c3e12-b96b-45e7-99c2-d2fcefdd1261 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.579246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb90a5-1cfe-41b3-a2d9-ab7922841623 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.600232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.600945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.601231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.601509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.602241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:26.602551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.603938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.625372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 332/662] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:26.626764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.628285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962f41d-6352-434a-bac3-08eb798f78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.628942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962f41d-6352-434a-bac3-08eb798f78a4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.629226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962f41d-6352-434a-bac3-08eb798f78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.629504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962f41d-6352-434a-bac3-08eb798f78a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.684675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:26.715179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962f41d-6352-434a-bac3-08eb798f78a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.717014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962f41d-6352-434a-bac3-08eb798f78a4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.737994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:26.747213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5870-c2bd-4999-a807-3aff947daaa1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.785555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.786702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.786988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.787371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.798121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.799855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:26.817754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:26.818696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:26.819636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:26.819636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:26.819636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:26.819636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:26.819636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 333/663] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:26.820352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.838992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 331/664] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:26.840470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea321-9d44-4ff4-8dc6-f75a7b4de88f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.840765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea321-9d44-4ff4-8dc6-f75a7b4de88f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.841042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea321-9d44-4ff4-8dc6-f75a7b4de88f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.842436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 332/665] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:26.843375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea321-9d44-4ff4-8dc6-f75a7b4de88f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:26.918371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:26.941964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1118797-454d-4447-875f-e0ad28ba806f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.950163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea321-9d44-4ff4-8dc6-f75a7b4de88f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:26.978417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c03a0f-0c1e-45a3-98ac-4999c879c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.979213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c03a0f-0c1e-45a3-98ac-4999c879c11a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.979498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c03a0f-0c1e-45a3-98ac-4999c879c11a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.979772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c03a0f-0c1e-45a3-98ac-4999c879c11a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.986763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c03a0f-0c1e-45a3-98ac-4999c879c11a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.988222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c03a0f-0c1e-45a3-98ac-4999c879c11a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:26.988346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:26.988928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:26.989214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:26.989492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:26.990217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:26.990519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:26.991868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-33c03a0f-0c1e-45a3-98ac-4999c879c11a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:27.002561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:27.003477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:27.005058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:27.005519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 333/666] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:27.005519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.012928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 334/667] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:27.012928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f9e4-8aa4-4222-aa5e-4174bbe46cfa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.012928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f9e4-8aa4-4222-aa5e-4174bbe46cfa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.012928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f9e4-8aa4-4222-aa5e-4174bbe46cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.015790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.028638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b970f9e4-8aa4-4222-aa5e-4174bbe46cfa None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:27.029830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b970f9e4-8aa4-4222-aa5e-4174bbe46cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:27.099586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 335/668] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:27.100536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f9e4-8aa4-4222-aa5e-4174bbe46cfa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.132501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e9b74-422b-4007-85f0-8587eb84284d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.162741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.168622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.169405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.169687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.173066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.180773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.182337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:27.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:27.201685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:27.203265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:27.203265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:27.203265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:27.203265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:27.203265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 334/669] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:27.203265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.219875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f9e4-8aa4-4222-aa5e-4174bbe46cfa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.257636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.261435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.261435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.261435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.261435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.266847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.268435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:27.282276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:27.283229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 336/670] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:27.285419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.318190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08862013-47ab-4d68-b01e-3140bfc93d49 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.355025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.355686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.355968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.356272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.357080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:27.357396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.358888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.377008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 335/671] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:27.377008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.407241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec2c87-c63b-4719-9335-71624f69b8fc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.419177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.447758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.448582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.448867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.449147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.459632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:27.467306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:27.468615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 337/672] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:27.469618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.485782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1998d9c-3646-490e-80e9-d77dde87909f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.521355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.522262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.522541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.522820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.523537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:27.523838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.525229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.528189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.536885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 336/673] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:27.537682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.572311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8cad-8c3d-4180-a977-c2817aa18314 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.607328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02cc29-24b0-4af2-b1a5-4a368ddf0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.607984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02cc29-24b0-4af2-b1a5-4a368ddf0b2b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.608296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02cc29-24b0-4af2-b1a5-4a368ddf0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.608576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02cc29-24b0-4af2-b1a5-4a368ddf0b2b None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.609364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02cc29-24b0-4af2-b1a5-4a368ddf0b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:27.609674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02cc29-24b0-4af2-b1a5-4a368ddf0b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.611101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02cc29-24b0-4af2-b1a5-4a368ddf0b2b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.623367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 338/674] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:27.624693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961797-c662-4fba-bdfb-cc2aa98b7e88 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.624982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961797-c662-4fba-bdfb-cc2aa98b7e88 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.625262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961797-c662-4fba-bdfb-cc2aa98b7e88 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.626678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 339/675] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:27.627191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89961797-c662-4fba-bdfb-cc2aa98b7e88 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.645706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d885b8-4492-4769-b757-db233ac1f312 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.647498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.679564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.680242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.680527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.680804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.681618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=d61999e7673a4a1cbc5ad487f8d16845) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:27.681924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.683334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.689195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 337/676] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/role_assignments?user.id=d61999e7673a4a1cbc5ad487f8d16845&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:27.690159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.734512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89961797-c662-4fba-bdfb-cc2aa98b7e88 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.753658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.775310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.782112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.782112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.782112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.782112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:27.782112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.782112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.793943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 340/677] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:27.793943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:27.823252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e06cb-a531-40ea-9bba-fd7f4ddf1146 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.865713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769783e-e6b5-438b-83a1-dfefca50b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.866613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769783e-e6b5-438b-83a1-dfefca50b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.866897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769783e-e6b5-438b-83a1-dfefca50b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.867179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769783e-e6b5-438b-83a1-dfefca50b8b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.875717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769783e-e6b5-438b-83a1-dfefca50b8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.878102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769783e-e6b5-438b-83a1-dfefca50b8b6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1769783e-e6b5-438b-83a1-dfefca50b8b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:27.893447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:27.894488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:27.895376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 338/678] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:27.896046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b4c7-beeb-44ba-ab03-eb28ac4ec23d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.896363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b4c7-beeb-44ba-ab03-eb28ac4ec23d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.896597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b4c7-beeb-44ba-ab03-eb28ac4ec23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.913302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c559dd9-50ca-468c-a72b-76b9feee2829 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:27.916263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-90e8b4c7-beeb-44ba-ab03-eb28ac4ec23d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:27.917440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-90e8b4c7-beeb-44ba-ab03-eb28ac4ec23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:27.939019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:27.952969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:27.953786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:27.953982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:27.954248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:27.955075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=32681494192c4f6c9ba36d68e4b6399b) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:27.955448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:27.957433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:27.963547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 341/679] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/role_assignments?user.id=32681494192c4f6c9ba36d68e4b6399b&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:27.964509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.000844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 339/680] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:28.002173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b4c7-beeb-44ba-ab03-eb28ac4ec23d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.043248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:28.119983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82395c7-beef-48d4-bf42-68e9c08e6b4b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.144350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b4c7-beeb-44ba-ab03-eb28ac4ec23d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.161135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.162081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.162466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.162841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.176558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:28.178021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:28.195120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.195790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.196130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.196477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.197295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:28.197607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:28.199034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:28.199570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:28.200428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:28.201754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:28.201754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:28.201754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:28.201754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:28.201754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 342/681] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:28.202029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.215579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 340/682] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:28.216468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.242421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:28.308709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:28.318088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20316f-0088-466b-8449-7921b33ae3aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.345290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83931e53-dfef-48b8-b63f-42c4eabb717b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.353395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.354187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.354470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.354746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.365822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:28.373373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:28.374305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 343/683] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:28.375798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.390943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.391755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.392039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.392349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.393469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:28.393787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:28.395464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:28.415993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 341/684] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:28.416982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.502922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:28.519430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2c0d0-773c-4ff6-a723-0016904394cd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.528207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1bccf-0ef3-4e3d-8328-34862e69b1a6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.566671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.567554 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.567969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.568408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.569382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=2d8183015eed4fd19e4a5fdf57d341e1) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:28.569863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:28.571675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:28.572836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.573609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.573986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.574462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.575261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:28.575670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:28.579708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 344/685] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/role_assignments?user.id=2d8183015eed4fd19e4a5fdf57d341e1&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:28.580809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.585580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:28.604115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 342/686] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:28.609396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.612912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:28.705722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc0a5-7844-4224-a128-f26d1af3045e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.747735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.748839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.749295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.749728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.759460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:28.761450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:28.779165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:28.780276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:28.781241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:28.785102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 345/687] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:28.795696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.861485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daa67b-1616-43dd-b37b-9717283646fa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.922737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.923897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.925288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:28.926237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.926718 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.936763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:28.942571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:28.944073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:28.954670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467ebe-f89c-496f-8625-cb0f25d5003f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:28.964589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:28.965492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:28.966388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:28.966388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:28.966388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:28.966388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:28.968775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 343/688] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:28.974840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:28.997890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:28.998610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:28.998851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:28.999130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:28.999968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:29.000304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:29.001737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:29.020300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 346/689] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:29.026765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:29.118601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177ab84-ad18-4ec9-953c-3525f73fc498 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:29.176736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:29.177402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:29.177683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:29.177958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:29.178684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:29.178988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:29.180386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:29.184453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7722d-9d76-437d-945a-58868b24b1d0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:29.205286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 344/690] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:29.212402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:29.260942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:29.267694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:29.267694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:29.267694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:29.267694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:29.280692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:29.340981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:29.342727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:29.355624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2086-f76a-4756-a467-a6e1f0d40707 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:29.405001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:29.405732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:29.406017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:29.406261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:29.414248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:29.415700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:29.452136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 347/691] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:29.455048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:29.456864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:29.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 345/692] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 07:59:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:29.459760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:29.465135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:29.499513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:29.570175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0fa0-98c1-443b-934b-504005c770b3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:29.613665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:29.614767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:29.615228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:29.616657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:29.637928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:29.639633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:29.668479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:29.669398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:29.670331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:29.670331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:29.670331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:29.670331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:29.672687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 348/693] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:29.678225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:29.691023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ac18-b721-4fbb-8ab6-6fb9bc97a025 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:29.711802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:29.769856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:29.770431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:29.770545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:29.770795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:29.771070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:29.772270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:29.772555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:29.773977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:29.788355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe28fe6-a75f-4063-a4e6-f4a21197c1de None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:29.814257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 346/694] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 07:59:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:29.821337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:29.831064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:29.832002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:29.832500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:29.832958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:29.833932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:29.834419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:29.835960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:29.849115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 349/695] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:29.854739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:29.984177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612a079-e6eb-46d2-b0df-60305fa4bf5e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:29.997971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca4e43-8c65-4e31-a025-3b0011add4b9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.021321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758db24-bc48-454a-aaa1-60aa81a99116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.022700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758db24-bc48-454a-aaa1-60aa81a99116 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.023187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758db24-bc48-454a-aaa1-60aa81a99116 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.023693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758db24-bc48-454a-aaa1-60aa81a99116 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.031234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758db24-bc48-454a-aaa1-60aa81a99116 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.033390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758db24-bc48-454a-aaa1-60aa81a99116 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.034002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac253-222a-40ea-8903-3d55ff9bb31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.034891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac253-222a-40ea-8903-3d55ff9bb31e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.035269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac253-222a-40ea-8903-3d55ff9bb31e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.035646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac253-222a-40ea-8903-3d55ff9bb31e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b758db24-bc48-454a-aaa1-60aa81a99116 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:30.048831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:30.050394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:30.051284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:30.053742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 350/696] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:30.059819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568439-f996-4bb8-a20b-deae92f7c50a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.060347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568439-f996-4bb8-a20b-deae92f7c50a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.060822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568439-f996-4bb8-a20b-deae92f7c50a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.062525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 351/697] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:30.063395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d568439-f996-4bb8-a20b-deae92f7c50a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.072988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.090342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.114622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac253-222a-40ea-8903-3d55ff9bb31e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.116220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac253-222a-40ea-8903-3d55ff9bb31e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.175457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d568439-f996-4bb8-a20b-deae92f7c50a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.213479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.214437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.214901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.215384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.216369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:30.216864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.218473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.233110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 347/698] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:30.233110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae0ff-5443-4eb5-82b8-9fcb98b801c7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.233110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae0ff-5443-4eb5-82b8-9fcb98b801c7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.233110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae0ff-5443-4eb5-82b8-9fcb98b801c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.235552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 352/699] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:30.236666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.249990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e17ae0ff-5443-4eb5-82b8-9fcb98b801c7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:30.251420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e17ae0ff-5443-4eb5-82b8-9fcb98b801c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:30.312228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.328379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 348/700] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:30.336381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ae0ff-5443-4eb5-82b8-9fcb98b801c7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.336381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.367777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f4611-e978-44b2-a120-355e9a3d81b1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.404299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.405448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.405956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.406433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.417628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.419184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:30.438544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:30.439445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:30.441430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:30.441430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:30.441430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:30.441430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:30.441430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 353/701] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:30.441936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.458915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ae0ff-5443-4eb5-82b8-9fcb98b801c7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.494675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bc00a-309f-4ea6-b80a-5251a3534cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.495259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc00a-309f-4ea6-b80a-5251a3534cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.495606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc00a-309f-4ea6-b80a-5251a3534cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.495809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc00a-309f-4ea6-b80a-5251a3534cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.496665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bc00a-309f-4ea6-b80a-5251a3534cf5 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7277ec365bac4e9d8a22f63c55bbb908) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:30.496971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bc00a-309f-4ea6-b80a-5251a3534cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.498527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bc00a-309f-4ea6-b80a-5251a3534cf5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.505322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 349/702] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/role_assignments?user.id=7277ec365bac4e9d8a22f63c55bbb908&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:30.506654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9675-83f3-486f-ad0f-51151707ac5f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.506943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9675-83f3-486f-ad0f-51151707ac5f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.507219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9675-83f3-486f-ad0f-51151707ac5f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.512604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 350/703] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:30.512604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9675-83f3-486f-ad0f-51151707ac5f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.574530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5f210-1dcd-4cfd-839a-d94c99980759 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.600699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.603116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.629437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913da67a-a9a1-4048-909b-d4f594e970d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.630544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da67a-a9a1-4048-909b-d4f594e970d8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.631607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da67a-a9a1-4048-909b-d4f594e970d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.632048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da67a-a9a1-4048-909b-d4f594e970d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.649777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913da67a-a9a1-4048-909b-d4f594e970d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.650061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9675-83f3-486f-ad0f-51151707ac5f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.651545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913da67a-a9a1-4048-909b-d4f594e970d8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-913da67a-a9a1-4048-909b-d4f594e970d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:30.675590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:30.676781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:30.677882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:30.677882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:30.677882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:30.677882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:30.683658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 354/704] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:30.685278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e820a-cbf5-42a9-b46a-86c3e6124e28 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.685638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e820a-cbf5-42a9-b46a-86c3e6124e28 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.685991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e820a-cbf5-42a9-b46a-86c3e6124e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.704177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.704723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2b6e820a-cbf5-42a9-b46a-86c3e6124e28 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:30.705833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.706181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.706462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.706558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2b6e820a-cbf5-42a9-b46a-86c3e6124e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:30.707194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:30.707503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.709697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.723348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 351/705] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:30.724231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.798234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 355/706] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:30.799689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e820a-cbf5-42a9-b46a-86c3e6124e28 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.867964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835564c-838b-446a-a746-239c6ca5f095 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.900637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.901943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e820a-cbf5-42a9-b46a-86c3e6124e28 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:30.904518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:30.917046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.917719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.918141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.918558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.919294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:30.919602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.921432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.934642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 352/707] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:30.935754 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:30.950918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:30.951730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:30.952159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:30.952418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:30.962049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:30.964021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:30.982888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:30.983969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:30.985029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 356/708] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:30.985562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.066889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f0ef-69f5-4885-8378-661e7d6ecea0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.106462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.107296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.107577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.107851 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.108603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.109293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fc76d-0af2-4cda-896e-eb26290a10eb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.109965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:31.130142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:31.131461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:31.132600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:31.134736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 353/709] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 07:59:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:31.135614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.154087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3bcb3-fb5d-43bb-9b01-47558d3389fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.154754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3bcb3-fb5d-43bb-9b01-47558d3389fc None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.155284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3bcb3-fb5d-43bb-9b01-47558d3389fc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.155562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3bcb3-fb5d-43bb-9b01-47558d3389fc None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.156669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3bcb3-fb5d-43bb-9b01-47558d3389fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.158154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3bcb3-fb5d-43bb-9b01-47558d3389fc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.192103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:31.244175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc9559-1a97-4306-9313-63d37e64541d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.278591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c565-d470-41d0-9247-655c0b80e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.279378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c565-d470-41d0-9247-655c0b80e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.279718 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c565-d470-41d0-9247-655c0b80e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.279996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c565-d470-41d0-9247-655c0b80e0c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.280830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c565-d470-41d0-9247-655c0b80e0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:31.281136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c565-d470-41d0-9247-655c0b80e0c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.282610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c565-d470-41d0-9247-655c0b80e0c2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.284879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 357/710] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 07:59:30 2022] POST /identity/v3/users => generated 254 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:31.286651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7e65-77ea-44c7-a589-65cf0df63cfd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.286944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7e65-77ea-44c7-a589-65cf0df63cfd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.287226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7e65-77ea-44c7-a589-65cf0df63cfd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.288632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 358/711] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:31.289330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf7e65-77ea-44c7-a589-65cf0df63cfd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.308513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 354/712] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:31.310949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bead05a-8fc5-4a81-a7ec-8b2821139a3b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.311594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bead05a-8fc5-4a81-a7ec-8b2821139a3b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.312050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bead05a-8fc5-4a81-a7ec-8b2821139a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.320163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:31.337370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3bead05a-8fc5-4a81-a7ec-8b2821139a3b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:31.339539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3bead05a-8fc5-4a81-a7ec-8b2821139a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:31.442423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf7e65-77ea-44c7-a589-65cf0df63cfd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.443103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 355/713] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:31.444087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bead05a-8fc5-4a81-a7ec-8b2821139a3b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.483008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.483970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.484314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.484594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.485304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:31.485611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.487533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.494174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 359/714] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 07:59:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:31.494808 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.502130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:31.591125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bead05a-8fc5-4a81-a7ec-8b2821139a3b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.598483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:31.619165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420779-9031-4bee-a92b-1678a18c0956 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.629263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.630280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.630799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.631316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.632379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7602c632829d44179aa129c552d1870a) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:31.632891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.634568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.640956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 356/715] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:31 2022] GET /identity/v3/role_assignments?user.id=7602c632829d44179aa129c552d1870a&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:31.642154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.657914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.658867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.658867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.659517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] PATH_INFO: `/v3/services/network` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.660072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.661683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:31.677245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:31.678322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:31.679158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 360/716] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:31 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:31.690933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.845455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:31.850367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5758-42c6-49a8-8107-7ff3cc9d4625 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.864947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1506-e540-4b69-86b3-e84aab6bf47d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:31.909954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.911448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.912372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.913154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.914551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] RBAC: Adding query filter params (name=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:31.915362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50c3b2-50b4-4905-8b4c-3c99db0ca81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:31.916276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c3b2-50b4-4905-8b4c-3c99db0ca81f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:31.916749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c3b2-50b4-4905-8b4c-3c99db0ca81f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:31.917215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c3b2-50b4-4905-8b4c-3c99db0ca81f None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:31.917712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.918623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50c3b2-50b4-4905-8b4c-3c99db0ca81f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:31.920210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.920725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50c3b2-50b4-4905-8b4c-3c99db0ca81f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:31.922243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50c3b2-50b4-4905-8b4c-3c99db0ca81f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:31.931110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 361/717] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 07:59:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:31.937885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:31.951685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 357/718] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 07:59:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:31.957032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:32.085958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35573-f854-41c2-ba46-5d5ebe00a23c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:32.131955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a915f5-0dd7-4f60-a6e2-23ecf5a381e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:32.133015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a915f5-0dd7-4f60-a6e2-23ecf5a381e5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:32.133501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a915f5-0dd7-4f60-a6e2-23ecf5a381e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:32.134078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a915f5-0dd7-4f60-a6e2-23ecf5a381e5 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:32.135003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a915f5-0dd7-4f60-a6e2-23ecf5a381e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:32.135510 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a915f5-0dd7-4f60-a6e2-23ecf5a381e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:32.137142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a915f5-0dd7-4f60-a6e2-23ecf5a381e5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:32.144001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 362/719] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 07:59:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:32.876459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50949f5-fbe0-4f90-ab38-6cfe840aa151 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:32.876949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50949f5-fbe0-4f90-ab38-6cfe840aa151 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:32.876949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50949f5-fbe0-4f90-ab38-6cfe840aa151 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:32.878973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 358/720] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:32.884452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0c8f-787b-41fe-abae-cb18bde79a4b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:32.884863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0c8f-787b-41fe-abae-cb18bde79a4b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:32.885036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0c8f-787b-41fe-abae-cb18bde79a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:32.902988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-461e0c8f-787b-41fe-abae-cb18bde79a4b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:32.904181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-461e0c8f-787b-41fe-abae-cb18bde79a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:32.997357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 363/721] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:59:33.040405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50949f5-fbe0-4f90-ab38-6cfe840aa151 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:33.153910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50949f5-fbe0-4f90-ab38-6cfe840aa151 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:33.194747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:33.195542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:33.195824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:33.196100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:33.207328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:33.215028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:33.215950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:33.216827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:33.220317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 359/722] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:33.222547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0c8f-787b-41fe-abae-cb18bde79a4b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:33.230919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:33.323429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0c8f-787b-41fe-abae-cb18bde79a4b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:33.373000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:33.373668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:33.373947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:33.374221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:33.375030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:33.375333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:33.376802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:33.391572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 364/723] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:33.398124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:33.428393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:33.545138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e471615-2f41-4cfd-ba71-443da57869eb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:33.602853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:33.603654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:33.603931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:33.604230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:33.624317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:33.625746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:33.648780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:33.649779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:33.650663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:33.650663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:33.650663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:33.650663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:33.650663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 360/724] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:33.661291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:33.738911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:33.779574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27cb0f-b32a-42e1-a275-3b9e29551142 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:33.816117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc72964-8bda-4b11-9363-7003bc15927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:33.816810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc72964-8bda-4b11-9363-7003bc15927e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:33.817097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc72964-8bda-4b11-9363-7003bc15927e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:33.817377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc72964-8bda-4b11-9363-7003bc15927e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:33.818102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc72964-8bda-4b11-9363-7003bc15927e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:33.818412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc72964-8bda-4b11-9363-7003bc15927e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:33.819776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc72964-8bda-4b11-9363-7003bc15927e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:33.836372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 365/725] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:33.838087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:33.938846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:33.965865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88076e8-c39b-40a4-992a-31d57ac91137 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:34.010013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:34.010808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.011092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.011368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.024507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:34.026035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:34.047150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:34.048118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:34.049748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:34.051735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 361/726] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:34.055241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35d4ef-5d14-4e34-9476-a03a92dc7fbf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.055748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35d4ef-5d14-4e34-9476-a03a92dc7fbf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.055913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35d4ef-5d14-4e34-9476-a03a92dc7fbf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.057178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 366/727] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:34.058496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:34.062449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66914b-aac3-4c08-a386-5de1f1a24d82 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.062731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66914b-aac3-4c08-a386-5de1f1a24d82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.063006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66914b-aac3-4c08-a386-5de1f1a24d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.087526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8c66914b-aac3-4c08-a386-5de1f1a24d82 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:34.088745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8c66914b-aac3-4c08-a386-5de1f1a24d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:34.203895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 367/728] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 07:59:34.206181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421642b-7296-48a0-9e4d-a7c7a83e72e7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.206480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421642b-7296-48a0-9e4d-a7c7a83e72e7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.206762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421642b-7296-48a0-9e4d-a7c7a83e72e7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.208348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 368/729] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:34.217461 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad09077-31ad-4f96-9dd3-be75a86bde93 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.217795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad09077-31ad-4f96-9dd3-be75a86bde93 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.218077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad09077-31ad-4f96-9dd3-be75a86bde93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.235978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020e2d-30d3-411e-a59c-891c7b8a6e19 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:34.244698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6ad09077-31ad-4f96-9dd3-be75a86bde93 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:34.245917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6ad09077-31ad-4f96-9dd3-be75a86bde93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:34.280995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:34.281587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.281870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.282146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.283144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:34.283455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:34.286113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:34.289093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:34.352395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 362/730] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 07:59:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:34.353359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:34.361556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:34.388278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 369/731] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:34.389427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad09077-31ad-4f96-9dd3-be75a86bde93 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:34.479660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57762bb0-9893-4dc8-b332-2e7847e0cdd5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:34.516388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:34.517454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.518424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.518893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.539783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:34.540351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad09077-31ad-4f96-9dd3-be75a86bde93 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:34.555967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:34.557852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:34.559498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:34.571089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 363/732] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:34.572935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:34.578274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:34.579029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.579383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.579837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.648803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:34.667620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:34.669496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:34.678876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:34.759020 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35bd5f-483a-44c1-be33-8428b2351477 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:34.795869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930fb4f-313a-4baa-8778-5cc923731cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:34.796612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930fb4f-313a-4baa-8778-5cc923731cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.796892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930fb4f-313a-4baa-8778-5cc923731cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.797008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 370/733] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 07:59:34.797190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930fb4f-313a-4baa-8778-5cc923731cb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.797815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:34.809894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930fb4f-313a-4baa-8778-5cc923731cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6930fb4f-313a-4baa-8778-5cc923731cb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:34.818308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:34.819473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:34.820375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 364/734] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:34.821099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1bfba-fffc-415c-96da-858681454a7a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.821514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1bfba-fffc-415c-96da-858681454a7a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.821608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1bfba-fffc-415c-96da-858681454a7a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.823128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 365/735] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:34.824368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f04a-82cb-4c56-9f9a-218e4cac3a0a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.824656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f04a-82cb-4c56-9f9a-218e4cac3a0a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.824928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f04a-82cb-4c56-9f9a-218e4cac3a0a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.826125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 366/736] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:34.826938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f04a-82cb-4c56-9f9a-218e4cac3a0a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:34.882330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:34.898140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8240ef-09e8-4b8a-a895-b20114c1b69a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:34.929339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f04a-82cb-4c56-9f9a-218e4cac3a0a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:34.930741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:34.931410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.931687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.931964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.932746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:34.933054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:34.934426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:34.943009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 371/737] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:34.943459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:34.944134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:34.967792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503e0e6-5e05-4c3a-8532-76146276ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:34.968631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503e0e6-5e05-4c3a-8532-76146276ee28 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:34.968916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503e0e6-5e05-4c3a-8532-76146276ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:34.969192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503e0e6-5e05-4c3a-8532-76146276ee28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:34.979632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503e0e6-5e05-4c3a-8532-76146276ee28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:34.981090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503e0e6-5e05-4c3a-8532-76146276ee28 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f503e0e6-5e05-4c3a-8532-76146276ee28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:34.998671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:34.999682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:35.001013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:35.001013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:35.001013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:35.001013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:35.001013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 367/738] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:35.001013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957b45-0d9a-42b7-842e-165b80c24722 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.001455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957b45-0d9a-42b7-842e-165b80c24722 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.001539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957b45-0d9a-42b7-842e-165b80c24722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.019388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-72957b45-0d9a-42b7-842e-165b80c24722 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:35.020595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-72957b45-0d9a-42b7-842e-165b80c24722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:35.046031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc436c-20fd-42c7-99e7-e07a8ad7030b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.080051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.080773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.081025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.081297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.082044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:35.082352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.083719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.086925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 368/739] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:35.088291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39232f84-bb10-4bdc-b439-dc3aa042ec2e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.088844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39232f84-bb10-4bdc-b439-dc3aa042ec2e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.088844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39232f84-bb10-4bdc-b439-dc3aa042ec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.096423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 372/740] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:35.096423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.106674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:35.116337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-39232f84-bb10-4bdc-b439-dc3aa042ec2e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:35.117521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-39232f84-bb10-4bdc-b439-dc3aa042ec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:35.183690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 369/741] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 07:59:35.184544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39232f84-bb10-4bdc-b439-dc3aa042ec2e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.196243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73474f-566b-4a74-b14a-d065586d9bb6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.213420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:35.232962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.233751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.234031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.245736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.247164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:35.264731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:35.265837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:35.266746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:35.266746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:35.266746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:35.266746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:35.266746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 373/742] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:35.266746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.290302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39232f84-bb10-4bdc-b439-dc3aa042ec2e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.324361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.324950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.325226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.325599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.325706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:35.326215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:35.326514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.327862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.342960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 370/743] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:35.343747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.371731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183f448-dd3d-446e-948a-0b9cda2734fe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.405994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.406772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.407052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.407334 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.418191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.419622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.428133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:35.436779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:35.443548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:35.444547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:35.444547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:35.444547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:35.444547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:35.444547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 374/744] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:35.444547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.444890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739a94-ca19-4488-8c46-68f042a43f62 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.476943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.477598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.477877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.478148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.478861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.480212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.541353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0ac1-ef98-46e5-b8bd-714c8062c470 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.554570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:35.568328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 371/745] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:59:35 2022] POST /identity/v3/services => generated 240 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:35.568328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.589059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.590354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.591109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.591443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.592512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.593762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.681458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 375/746] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:59:35 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:35.682378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.704995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ace3-bb90-48bb-9ecb-a2246964ef5f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.777181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.777873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.778158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.778438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.779187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:35.779486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.781660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.802277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 372/747] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:35.803172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.807856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:35.824039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713add5-48a5-441c-84b3-d85613f5bb79 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.866992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.867776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.868057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.868393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.876692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.878469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:35.896323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:35.897735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:35.898802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 376/748] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:35.899302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:35.928459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e468f-29a3-4495-8432-c5e6f73e5fc2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:35.934460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:35.965464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:35.966125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:35.966403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:35.966679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:35.967400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:35.967706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:35.969085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:35.982618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 373/749] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:35.983454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:36.017326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e9f6-ea15-44ba-935b-eef67d9cb445 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.047580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:36.058042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.058861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.059142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.059477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.069050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.071017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:36.088542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d830-3fa7-4a6d-8967-3f0362722066 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:36.092925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:36.094196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:36.095152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 377/750] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:36.095755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:36.133415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.134227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.134578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.134923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.135821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:36.136222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.138183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:36.154647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 374/751] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:36.155562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:36.204120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:36.212254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1fbd6-8975-407e-9709-c6b757c1cc08 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.248294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.249446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.251597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.252056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.261109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.262831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:36.278106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:36.279078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:36.280026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:36.282649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 378/752] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 07:59:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:36.283706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:36.289056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1e71-101e-43a8-a4e0-b6a528b8cb99 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.347458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:36.359747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.361305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.361305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.361305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.362335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:36.362515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.364058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:36.384852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 375/753] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 07:59:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:36.385738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:36.437066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0940-0bfd-45ce-afc2-fbf9dc692ad3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.476480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.477534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.477994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.478538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.479628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7277ec365bac4e9d8a22f63c55bbb908) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:36.480163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.481934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:36.490123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 379/754] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:36 2022] GET /identity/v3/role_assignments?user.id=7277ec365bac4e9d8a22f63c55bbb908&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:36.491508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:36.499736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586d3f1-0195-4c3d-b9e3-a44a4b81270b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.510762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:36.584323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.585112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.585397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.585671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.586523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:36.586826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.588281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:36.634164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 376/755] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 07:59:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:36.639877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:36.654008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788902-e44d-407f-a668-3682cb9b1908 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.717005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.718042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.718524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.719025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.720726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:36.863070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52eda55-0b19-4a72-b402-0fcb91872796 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:36.887205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.888705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:36.905236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:36.951796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:36.952643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:36.952925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:36.953198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:36.976692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:36.978150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:37.008522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:37.009485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:37.010410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:37.010410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:37.010410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:37.010410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:37.011577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 377/756] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:37.017597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:37.048809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 380/757] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:59:37.055626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:37.139748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:37.153528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64fe2-098c-4415-a90e-db3a00b4727e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:37.222221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:37.222808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:37.223090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:37.223369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:37.224093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:37.224427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:37.225819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:37.249127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 378/758] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:37.254217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:37.267208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686a83-d6f3-41a7-a2a4-ced1ba704ce0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:37.293514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:37.328432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:37.329301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:37.329586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:37.329865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:37.358033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:37.359503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:37.383355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:37.384385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:37.385313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:37.385313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:37.385313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:37.385313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:37.387756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 381/759] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:37.395637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:37.449438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d1234-0096-4212-a3c6-5dc99c848358 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:37.512506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:37.513332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:37.513618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:37.513925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:37.527080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:37.529369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:37.553080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:37.554028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:37.554906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 379/760] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:37.560044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:37.583359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:37.591058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56a0f-f864-477b-9be2-6d22a935232a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:37.660062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:37.661002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:37.661458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:37.661911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:37.662791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:37.663248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:37.664788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:37.687096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 382/761] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:37.694093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:37.736560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:37.751247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88830d5e-8202-495b-bba9-943352f24e00 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:37.826103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:37.826696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:37.826981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:37.827258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:37.828054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:37.828389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:37.829817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:37.853207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 380/762] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:37.859875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:37.890891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8424d-0cba-4164-aac8-27b302bce84a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:37.955879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171410c-db3f-4f98-80ea-ecac7b36c9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:37.957023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171410c-db3f-4f98-80ea-ecac7b36c9ac None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:37.957547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171410c-db3f-4f98-80ea-ecac7b36c9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:37.958016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171410c-db3f-4f98-80ea-ecac7b36c9ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:37.967426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171410c-db3f-4f98-80ea-ecac7b36c9ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:37.969152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171410c-db3f-4f98-80ea-ecac7b36c9ac None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:37.979661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c171410c-db3f-4f98-80ea-ecac7b36c9ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:37.986114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:37.997352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 383/763] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cf42-fda0-4949-a2de-50b8de5d2c8b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:37.998256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cf42-fda0-4949-a2de-50b8de5d2c8b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:37.998889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cf42-fda0-4949-a2de-50b8de5d2c8b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:37.999796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 384/764] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:38.000792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cf42-fda0-4949-a2de-50b8de5d2c8b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:38.016772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad25f8f-baae-4186-a102-a53db54466be None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:38.054737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ef7f-7018-4707-8a71-f53dd4bc5993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:38.055881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ef7f-7018-4707-8a71-f53dd4bc5993 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.056173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ef7f-7018-4707-8a71-f53dd4bc5993 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.056475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ef7f-7018-4707-8a71-f53dd4bc5993 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/7602c632829d44179aa129c552d1870a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.058452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ef7f-7018-4707-8a71-f53dd4bc5993 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=7602c632829d44179aa129c552d1870a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:38.059893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ef7f-7018-4707-8a71-f53dd4bc5993 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:38.100884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:38.117628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cf42-fda0-4949-a2de-50b8de5d2c8b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:38.132241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 381/765] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:37 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/7602c632829d44179aa129c552d1870a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:38.133571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7d64c-43e8-4f19-b60f-e9d5b95dae5c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.133865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7d64c-43e8-4f19-b60f-e9d5b95dae5c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.134138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7d64c-43e8-4f19-b60f-e9d5b95dae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.152970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5dc7d64c-43e8-4f19-b60f-e9d5b95dae5c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:38.154215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5dc7d64c-43e8-4f19-b60f-e9d5b95dae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:38.171974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e37ac-4a9b-4e59-9a92-31ae52ee8d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:38.173360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e37ac-4a9b-4e59-9a92-31ae52ee8d05 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.173877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e37ac-4a9b-4e59-9a92-31ae52ee8d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.174793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e37ac-4a9b-4e59-9a92-31ae52ee8d05 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.176330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e37ac-4a9b-4e59-9a92-31ae52ee8d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:38.176885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e37ac-4a9b-4e59-9a92-31ae52ee8d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:38.178564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e37ac-4a9b-4e59-9a92-31ae52ee8d05 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:38.197703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 385/766] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:38.200521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506c19-ded2-4eef-a503-35ae54d4c8a5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.201049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506c19-ded2-4eef-a503-35ae54d4c8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.201549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506c19-ded2-4eef-a503-35ae54d4c8a5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.203347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 386/767] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:38.204339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0506c19-ded2-4eef-a503-35ae54d4c8a5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:38.248933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 382/768] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:38.250401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f274-3a04-4d38-ac53-9ee4b5e895ce None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.250699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f274-3a04-4d38-ac53-9ee4b5e895ce None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.250989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f274-3a04-4d38-ac53-9ee4b5e895ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.285750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6131f274-3a04-4d38-ac53-9ee4b5e895ce None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:38.287660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6131f274-3a04-4d38-ac53-9ee4b5e895ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:38.337484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0506c19-ded2-4eef-a503-35ae54d4c8a5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:38.353901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:38.374820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 383/769] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:38.375824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131f274-3a04-4d38-ac53-9ee4b5e895ce None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:38.380063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:38.381575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.382263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.382967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.384647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=650f8582a9ce4fc29f1a31e01dd74cbb) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:38.386054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:38.387708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:38.395799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 387/770] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:38 2022] GET /identity/v3/role_assignments?user.id=650f8582a9ce4fc29f1a31e01dd74cbb&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:38.410568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:38.430661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:38.546562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131f274-3a04-4d38-ac53-9ee4b5e895ce None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:38.614988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:38.616143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.616853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.617673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] PATH_INFO: `/v3/services/network` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.618757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:38.620956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:38.623702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16dba-eaa0-47c5-9322-e7e42f73e621 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:38.637194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:38.638428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:38.639496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:38.643770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 384/771] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:38 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:38.651438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:38.680395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:38.681681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.683549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.684734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.685822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:38.688325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:38.711350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:38.712784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:38.713796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:38.718121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 388/772] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 07:59:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:38.729534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:38.762553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:38.819661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:38.832484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11d44a-e77f-4f23-ad17-11ef5bc9256b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:38.849976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91ba3-39ac-4f43-a2f7-6993706797b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:38.877099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee1c3-7c0a-43b9-87ea-30967409d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:38.878721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee1c3-7c0a-43b9-87ea-30967409d941 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.879156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee1c3-7c0a-43b9-87ea-30967409d941 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.879526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee1c3-7c0a-43b9-87ea-30967409d941 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.880721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee1c3-7c0a-43b9-87ea-30967409d941 None admin] RBAC: Adding query filter params (name=network) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:38.881445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee1c3-7c0a-43b9-87ea-30967409d941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:38.883141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee1c3-7c0a-43b9-87ea-30967409d941 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:38.888881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 385/773] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 07:59:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:38.890250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8488d6b-cfb0-46ce-8ff4-036bbdbb35ba None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.899819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8488d6b-cfb0-46ce-8ff4-036bbdbb35ba None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.899819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8488d6b-cfb0-46ce-8ff4-036bbdbb35ba None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.899819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 386/774] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:38.899819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8488d6b-cfb0-46ce-8ff4-036bbdbb35ba None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:38.903968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ff9cf-a778-4978-8612-da3c63c9628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:38.904900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff9cf-a778-4978-8612-da3c63c9628a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.905392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff9cf-a778-4978-8612-da3c63c9628a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.905807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff9cf-a778-4978-8612-da3c63c9628a None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.906805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ff9cf-a778-4978-8612-da3c63c9628a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:38.907121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ff9cf-a778-4978-8612-da3c63c9628a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:38.908568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ff9cf-a778-4978-8612-da3c63c9628a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:38.915602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 389/775] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 07:59:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:38.920092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149727-04a5-4fbb-84cf-f026af230b7e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:38.920092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149727-04a5-4fbb-84cf-f026af230b7e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:38.920092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149727-04a5-4fbb-84cf-f026af230b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:38.942809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f7149727-04a5-4fbb-84cf-f026af230b7e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:38.945441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7149727-04a5-4fbb-84cf-f026af230b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:39.016047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8488d6b-cfb0-46ce-8ff4-036bbdbb35ba None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.035447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:39.044666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 390/776] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:39.044666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149727-04a5-4fbb-84cf-f026af230b7e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.070924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.072161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.072892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.073405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.074784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:39.075324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.076990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.084640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 387/777] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 07:59:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:39.086274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.126402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:39.166091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149727-04a5-4fbb-84cf-f026af230b7e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.205011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.205869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.206228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.206564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.207371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:39.207887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.209423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.219511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 391/778] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:39.219511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.220410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4171417-ec57-4691-a159-8a76d671dfd6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.264051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.265672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.266136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.266585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.281220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:39.292738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:39.293723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:39.294567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:39.297639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 388/779] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:39.298558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.348764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52743-3122-4d7f-b522-725e0a8318ed None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.351903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:39.389913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:39.399394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.400566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.401102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.401558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.402703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] RBAC: Adding query filter params (interface=public, service_id=9620903601fa44ee926ef64abda14e72, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:39.403634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.405677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.412809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23fc17-1079-4291-8b2f-98c616be0c66 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.417174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 392/780] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/endpoints?service_id=9620903601fa44ee926ef64abda14e72&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:39.418137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.453449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.454291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.454677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.455076 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.456639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] RBAC: Adding query filter params (interface=public, service_id=5456ea6b61d74d7f86301135eea9470d, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:39.457079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.458591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.472281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 389/781] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/endpoints?service_id=5456ea6b61d74d7f86301135eea9470d&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:39.472281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.560569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9176-7c81-4fde-9751-c488dda7ee46 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.588832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea21a-6948-45e6-b75e-84fb21e250a5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.598669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:39.612446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.613923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.614351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.615037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.616085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:39.620289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.620289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.627723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.628718 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.629066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.629411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.630179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.630560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 393/782] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:39.631676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.632091 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.648373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 390/783] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:39.649610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:39.701272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:39.762176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3827-b884-4c0f-a8d4-1a1f381b4939 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.841380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.841879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.842168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.842447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.843549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.844538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.852464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 394/784] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:39.867935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e663-b5a4-4dad-b30a-9f98ebd47ab5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:39.915225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:39.916450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:39.916952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:39.917439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:39.932781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:39.934570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:39.959689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:39.960714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:39.961625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:39.961625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:39.961625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:39.961625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:39.961625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 391/785] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:39.966591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:40.089602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138031-a132-456f-91f8-b21150bf9baf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:40.110772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:40.126930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:40.127633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.127914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.128205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.128945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:40.129250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:40.130685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:40.144993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 395/786] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:40.150455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:40.179924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:40.274934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eafe1-c663-45ca-b38f-6782a37f1d59 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:40.328488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fbaf3-90dc-420c-9558-c550a67a8ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:40.329287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fbaf3-90dc-420c-9558-c550a67a8ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.329571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fbaf3-90dc-420c-9558-c550a67a8ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.329847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fbaf3-90dc-420c-9558-c550a67a8ef5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.341392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fbaf3-90dc-420c-9558-c550a67a8ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:40.342901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fbaf3-90dc-420c-9558-c550a67a8ef5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-701fbaf3-90dc-420c-9558-c550a67a8ef5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:40.359910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:40.360935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:40.362064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 392/787] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:40.367292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:40.423649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e4015-9554-4781-9d67-0d724a2c0bfb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.423972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e4015-9554-4781-9d67-0d724a2c0bfb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.424327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e4015-9554-4781-9d67-0d724a2c0bfb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.425991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 393/788] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:40.431098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2366-a92a-4cc5-adfe-6f25efcad122 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.431388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2366-a92a-4cc5-adfe-6f25efcad122 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.431671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2366-a92a-4cc5-adfe-6f25efcad122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.449064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c16a2366-a92a-4cc5-adfe-6f25efcad122 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:40.450256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c16a2366-a92a-4cc5-adfe-6f25efcad122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:40.537469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63d811-9e13-40c5-be5d-32dce3aae3e0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:40.606402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:40.608438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.610075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.610557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.613755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 394/789] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:59:40.613922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:40.614355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:40.621157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:40.655549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 396/790] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 07:59:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:40.662241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2366-a92a-4cc5-adfe-6f25efcad122 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:40.666953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:40.704556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:40.770923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:40.832800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2366-a92a-4cc5-adfe-6f25efcad122 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:40.859586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe2c7-3277-4f40-9445-eace666cf4c5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:40.892755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8a0f-afb4-4972-bca8-e96998fec6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:40.895156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8a0f-afb4-4972-bca8-e96998fec6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.895956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8a0f-afb4-4972-bca8-e96998fec6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.896696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8a0f-afb4-4972-bca8-e96998fec6a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.899641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6a77e-b1c4-43c7-9d50-abfa60bfe61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:40.900449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a77e-b1c4-43c7-9d50-abfa60bfe61e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.900757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a77e-b1c4-43c7-9d50-abfa60bfe61e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.901172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a77e-b1c4-43c7-9d50-abfa60bfe61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.912646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6a77e-b1c4-43c7-9d50-abfa60bfe61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:40.914097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6a77e-b1c4-43c7-9d50-abfa60bfe61e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:40.917129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8a0f-afb4-4972-bca8-e96998fec6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-adf6a77e-b1c4-43c7-9d50-abfa60bfe61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:40.931977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:40.933814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:40.935903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:40.935903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:40.935903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:40.935903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ad2b8a0f-afb4-4972-bca8-e96998fec6a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:40.937109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:40.938930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:40.941887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:40.944063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 397/791] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:40.944063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454c799-39a2-4ad1-83b6-928d16a62ac5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.944063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454c799-39a2-4ad1-83b6-928d16a62ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.944063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454c799-39a2-4ad1-83b6-928d16a62ac5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.945922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 398/792] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:40.945922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454c799-39a2-4ad1-83b6-928d16a62ac5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:40.948219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 395/793] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:40.950782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74df159-387a-43d9-813e-8f68f122129f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:40.951483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74df159-387a-43d9-813e-8f68f122129f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:40.952242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74df159-387a-43d9-813e-8f68f122129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:40.982575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f74df159-387a-43d9-813e-8f68f122129f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:40.985196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f74df159-387a-43d9-813e-8f68f122129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:41.050209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:41.061496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454c799-39a2-4ad1-83b6-928d16a62ac5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.103827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.104533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.104877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.105219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.106016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:41.106394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.107832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:41.120675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 399/795] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:41.120976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 396/795] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:41.121667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.134206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74df159-387a-43d9-813e-8f68f122129f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.140122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:41.242718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854bd4d-2889-4683-ba36-50beba02972b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.278397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.279154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.279494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.279861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.280700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:41.281084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.282526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:41.291776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 400/796] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:41.296617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.312580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:41.357380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74df159-387a-43d9-813e-8f68f122129f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.398494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf63f-7327-4a2a-a7e8-9e7b1b05398c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.422189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.423807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.425207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.426269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.433943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.434799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.435152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.435478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.441493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.444716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:41.446427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:41.454182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:41.456318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:41.457812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:41.458916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 401/797] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:41.465017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:41.477844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:41.478998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:41.480148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:41.482328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 397/798] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:41.483264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.561685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:41.564330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:41.609607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38b02-4f56-4b63-829c-e66de4aa4704 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.611343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28faa67-6bbb-4817-847f-8953dec91400 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.649590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.649916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.650690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.651025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.651141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.651507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.651789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.652228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.652577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:41.652976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.654431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:41.667865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 398/799] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:41.667865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.669345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.670978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:41.689703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:41.691462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:41.692620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:41.692620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:41.692620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:41.692620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:41.694600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 402/800] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:41.695545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.782152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228d79e-0b68-4200-9349-30d4d54f8c48 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.804249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0d457-97ed-4ff0-8fbd-3c8e554cd950 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.807237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:41.819889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.820882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.821330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.824517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.824517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:41.824517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.824517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:41.830968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:41.837808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 399/801] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:41.838984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.843266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.844054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.844466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.844819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.856718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.858179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:41.876605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:41.877801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:41.879283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:41.879283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:41.879283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:41.879283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:41.883381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 403/802] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:41.884246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:41.952941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867e5d-6157-4737-b0ae-fc531d9ddaba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.989681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:41.990771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:41.991283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:41.991675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d67fb-4a38-4843-8c57-3562d81e44bd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:41.991977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:41.992943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:41.993467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:41.995035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.012597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 400/803] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:42.013787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.028714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.029594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.029879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.030157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/7277ec365bac4e9d8a22f63c55bbb908/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.032295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=7277ec365bac4e9d8a22f63c55bbb908, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.033675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.065435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:42.117056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 404/804] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:41 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/7277ec365bac4e9d8a22f63c55bbb908/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:42.118139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.146715 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba5380-743e-4fc1-960d-12c3a64e55f9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.178445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:42.188820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de4cfa-a45a-4072-aa7d-68b073bdbd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.192911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4cfa-a45a-4072-aa7d-68b073bdbd56 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.192911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4cfa-a45a-4072-aa7d-68b073bdbd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.192911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4cfa-a45a-4072-aa7d-68b073bdbd56 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.192911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4cfa-a45a-4072-aa7d-68b073bdbd56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:42.192911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4cfa-a45a-4072-aa7d-68b073bdbd56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.193528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4cfa-a45a-4072-aa7d-68b073bdbd56 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.208376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 401/805] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:42.214593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717e948-e703-483c-b440-6a57cfad86ba None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.214879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717e948-e703-483c-b440-6a57cfad86ba None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.215163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717e948-e703-483c-b440-6a57cfad86ba None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.220614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 402/806] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:42.220614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717e948-e703-483c-b440-6a57cfad86ba None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.265722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821d50-f331-49e6-814c-d63817b11b70 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.307237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72cf74-291a-4ea3-95ea-4ecd0f36ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.308302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cf74-291a-4ea3-95ea-4ecd0f36ab7b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.308753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cf74-291a-4ea3-95ea-4ecd0f36ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.309293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cf74-291a-4ea3-95ea-4ecd0f36ab7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.318657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72cf74-291a-4ea3-95ea-4ecd0f36ab7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.322538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72cf74-291a-4ea3-95ea-4ecd0f36ab7b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1b72cf74-291a-4ea3-95ea-4ecd0f36ab7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:42.337670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:42.338881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 07:59:42.340064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:42.342078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 405/807] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:42.342869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717e948-e703-483c-b440-6a57cfad86ba None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.343550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82844-b556-4f51-b59a-e06cffb29e3c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.343817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82844-b556-4f51-b59a-e06cffb29e3c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.344098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82844-b556-4f51-b59a-e06cffb29e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.346353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:42.366264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0de82844-b556-4f51-b59a-e06cffb29e3c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:42.367845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0de82844-b556-4f51-b59a-e06cffb29e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:42.387139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.388613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.389035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.389515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.399277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.401044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:42.417171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:42.418217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:42.419395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:42.421714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 403/808] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:42.422743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.448836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 406/809] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:42.449868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de82844-b556-4f51-b59a-e06cffb29e3c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.490077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:42.558381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e68e-29d3-4be4-94d7-e2ad762377f7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.586591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de82844-b556-4f51-b59a-e06cffb29e3c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.609718 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.610777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.611248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.612253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.613751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:42.614259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.616790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.644333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f055e-d34e-4bba-81a3-be9ecfd2a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.649248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 404/810] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:42.649427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f055e-d34e-4bba-81a3-be9ecfd2a9fb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.649427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f055e-d34e-4bba-81a3-be9ecfd2a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.649427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f055e-d34e-4bba-81a3-be9ecfd2a9fb None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.649650 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.649721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f055e-d34e-4bba-81a3-be9ecfd2a9fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:42.649721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f055e-d34e-4bba-81a3-be9ecfd2a9fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.649721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f055e-d34e-4bba-81a3-be9ecfd2a9fb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.671850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 407/811] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:42.673041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:42.673418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfae1-b3bf-4c87-b458-7c215d4a5da8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.675751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfae1-b3bf-4c87-b458-7c215d4a5da8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.676302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfae1-b3bf-4c87-b458-7c215d4a5da8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.677756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 408/812] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:42.678639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfae1-b3bf-4c87-b458-7c215d4a5da8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.756379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36affd-600e-4fbd-9764-b7b20c1624d0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.773838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:42.791516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfae1-b3bf-4c87-b458-7c215d4a5da8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.792156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.793065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.793399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.793735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] PATH_INFO: `/v3/services/network` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.794438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.795849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:42.808394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:42.809571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:42.810434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 405/813] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:42.811229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:42.832656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.833306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.833589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.833860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.902993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:42.909197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.910824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.919236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c44e1-f844-46e2-b869-588154f9cc19 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:42.954260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fa9c0-edc4-4fe9-9d98-d0897bff9bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:42.955189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fa9c0-edc4-4fe9-9d98-d0897bff9bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.955606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fa9c0-edc4-4fe9-9d98-d0897bff9bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.955969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fa9c0-edc4-4fe9-9d98-d0897bff9bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:42.967235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fa9c0-edc4-4fe9-9d98-d0897bff9bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:42.968836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fa9c0-edc4-4fe9-9d98-d0897bff9bd3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-980fa9c0-edc4-4fe9-9d98-d0897bff9bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:42.989117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:42.990071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:42.990970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:42.990970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:42.990970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:42.990970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:42.992871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 406/814] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:42.994324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f7da-ca07-40b7-90af-9a0ad3147d0b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:42.995147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f7da-ca07-40b7-90af-9a0ad3147d0b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:42.995546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f7da-ca07-40b7-90af-9a0ad3147d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.002262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.015263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3121f7da-ca07-40b7-90af-9a0ad3147d0b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:43.017070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3121f7da-ca07-40b7-90af-9a0ad3147d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:43.024028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 409/815] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:59:43.024028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.100514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 407/816] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:43.102447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f7da-ca07-40b7-90af-9a0ad3147d0b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.123719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d1880-b64e-4e6f-9c16-f9a03b03d4ce None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.161017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.161721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.162008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.162397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.163102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] RBAC: Adding query filter params (name=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:43.163410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.164912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.174797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 410/817] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:43.174797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.176467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.212686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f7da-ca07-40b7-90af-9a0ad3147d0b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.223829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.252975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.254029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.254577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.255074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.255917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:43.256324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.257806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.275418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170dff6-e916-4b60-9801-704faf681edb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.276510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 408/818] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:43.277831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.314951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.315777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.316012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.316310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.327458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.328933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:43.349183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:43.350157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:43.351056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:43.351056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:43.351056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:43.351056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:43.351056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 411/819] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:43.351424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.392176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868191f-4a21-4c75-8296-4aa4eadb93de None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.419908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.429324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.430193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.430477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.430756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.431433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.432880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:43.445248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:43.446168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:43.447008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 409/820] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:43.447846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.465219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.468578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe0a78-904a-4671-a144-be4ffb7802d1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.504272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.504935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.505216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.505491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.506192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:43.506562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.507985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.513652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 412/821] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:43.517169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.556807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afe2f5-2212-4748-ac46-3fbacdafd7c5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.605033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.605821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.606101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.606399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.613983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.615394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:43.630497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:43.631401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:43.632342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:43.632844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.645452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df27ae-34f4-4dfc-967d-35d75286c63f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.686497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.687085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.687364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.687638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.688383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:43.688686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.689126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.691870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.709865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 413/823] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:43.709865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.739417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.743070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa93dc-25e8-4746-863b-136aa6c3f55c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.780258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.780917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.781198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.781470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.782171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:43.782468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.784424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.788863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 411/824] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:43.789650 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.831420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e8bf-5c3d-40e3-bed8-85bd5ccdca4b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.868744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.869754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.870265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.870784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.871822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.873346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.895031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5032-4f19-4ae9-b5c7-607b777795ba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:43.912600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:43.930221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:43.930916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:43.931203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:43.931483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:43.932299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:43.932613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:43.934056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:43.946199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 412/825] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:43.946922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:43.995857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 414/826] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 07:59:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:43.996807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:44.110859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:44.145000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb1f7a-fb20-431d-913c-42c494242318 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:44.184301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f43ea-fc5a-4a03-9a56-a9e884f164e8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:44.199394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:44.199706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.199984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.200286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.201027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:44.201327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:44.202707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:44.208605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 415/827] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:44.209397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:44.231954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:44.232934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.233316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.233669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.242082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:44.243752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:44.259581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:44.264429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 413/828] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:44.265385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:44.306961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:44.326917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abd37-2337-41fa-8997-6548d42c5585 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:44.360392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:44.361278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.361555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.362492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/650f8582a9ce4fc29f1a31e01dd74cbb/roles/f40fb8f3b0f14a92a30b875528b909f4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.371180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72efbb-8282-4a48-ae0d-06c19e8ab4b4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:44.373139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:44.377379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=650f8582a9ce4fc29f1a31e01dd74cbb, role_id=f40fb8f3b0f14a92a30b875528b909f4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:44.379570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:44.405629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa9f59-c256-4c3b-baa7-72907ebef000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:44.406289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9f59-c256-4c3b-baa7-72907ebef000 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.406573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9f59-c256-4c3b-baa7-72907ebef000 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.406850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9f59-c256-4c3b-baa7-72907ebef000 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.407584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa9f59-c256-4c3b-baa7-72907ebef000 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:44.409557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa9f59-c256-4c3b-baa7-72907ebef000 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:44.485750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 416/829] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:44 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/650f8582a9ce4fc29f1a31e01dd74cbb/roles/f40fb8f3b0f14a92a30b875528b909f4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:44.487342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:44.536116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 414/830] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 07:59:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:44.536116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e3910-c2c3-44fa-8d23-e7eaf96fb658 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.536116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e3910-c2c3-44fa-8d23-e7eaf96fb658 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.536116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e3910-c2c3-44fa-8d23-e7eaf96fb658 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.536116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 415/831] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:44.539037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8cb83-cdf7-48da-ad91-82c0402b5154 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.539037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8cb83-cdf7-48da-ad91-82c0402b5154 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.539037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8cb83-cdf7-48da-ad91-82c0402b5154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.559311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-20b8cb83-cdf7-48da-ad91-82c0402b5154 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:44.560934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-20b8cb83-cdf7-48da-ad91-82c0402b5154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:44.647548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240e9f-08ac-42dd-b3cb-b8f12497b27a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:44.660577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 416/832] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:59:44.686229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8cb83-cdf7-48da-ad91-82c0402b5154 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:44.689592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:44.690633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.691130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.691625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.692703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:44.693253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:44.694941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:44.707526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:44.709777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 417/833] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:44.715391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:44.776457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:44.808568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8cb83-cdf7-48da-ad91-82c0402b5154 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:44.832104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e738c5-bc90-4d7d-9196-43b178cecdb2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:44.855059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:44.856401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.856818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.857218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.867101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:44.867758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:44.868037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:44.868338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:44.869165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7602c632829d44179aa129c552d1870a) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:44.869473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:44.870934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:44.877409 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 418/834] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:44 2022] GET /identity/v3/role_assignments?user.id=7602c632829d44179aa129c552d1870a&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:44.879517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:44.887961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:44.889080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:59:44.889926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:44.893462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 417/835] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:44.902105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:45.025030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c89906-5cf3-471f-bc1b-a6120f49b9e2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:45.041531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:45.062911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:45.063582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:45.063861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:45.064133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:45.065319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:45.065627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:45.067067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:45.076878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 419/836] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 07:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:45.082890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:45.170858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:45.193755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f58f2-7963-41ac-9005-9913abc1567a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:45.236212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:45.237195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:45.237482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:45.237768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:45.249438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:45.250892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:45.270570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:45.271488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:45.272691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:45.272691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:45.272691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:45.272691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:45.272691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 418/837] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:45.279095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:45.393951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e73f-a453-4008-b8bd-52ed142dc426 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:45.430934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:45.432466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:45.433019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:45.433607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:45.434858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:45.435373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:45.436972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:45.450232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 420/838] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:45.456761 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:45.588655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1dca3-ed95-4486-90ec-a57d2b4a4677 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:45.629970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:45.636949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:45.637752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:45.638026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:45.638295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:45.648188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:45.650742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:45.671908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:45.672955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 07:59:45.673904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:45.675197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 419/839] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 07:59:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:45.682965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:45.730001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:45.822465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1517a1-ef81-47d0-96ad-3d7f847fbe49 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:45.859545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:45.860223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:45.860517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:45.860789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:45.861872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:45.862059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:45.863465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:45.883940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 421/840] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 07:59:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:45.889884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:45.998848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93113-8d46-49dd-ba7c-7bcad07da74b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:46.036838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:46.037486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.037764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.038036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.099465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:46.109865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:46.111309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:46.226655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 420/841] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 07:59:46.232235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:46.336842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:46.344057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd20c-1187-4256-896a-2decdc325b99 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:46.387038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:46.387844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.388132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.388439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.403514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:46.403514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:46.421085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:46.422011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:46.422910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:46.422910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:46.422910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:46.422910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:46.422910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 422/842] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:46.432545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:46.628655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:46.637742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac066a88-ab6f-483c-9aa5-32c76cfc75da None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:46.710753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38746-fbf8-4c68-bb5d-69ef21386667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:46.711436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38746-fbf8-4c68-bb5d-69ef21386667 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.711715 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38746-fbf8-4c68-bb5d-69ef21386667 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.711986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38746-fbf8-4c68-bb5d-69ef21386667 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.715454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb38746-fbf8-4c68-bb5d-69ef21386667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:46.715773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb38746-fbf8-4c68-bb5d-69ef21386667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:46.717186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb38746-fbf8-4c68-bb5d-69ef21386667 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:46.747221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 421/843] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:46.757287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:46.831284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46506d-1f08-499c-ad41-9cfd460796cf None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.831742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46506d-1f08-499c-ad41-9cfd460796cf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.831849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46506d-1f08-499c-ad41-9cfd460796cf None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.837537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 422/844] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:46.838753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0375-b8a0-4242-8512-2176e2810415 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.839046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0375-b8a0-4242-8512-2176e2810415 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.839329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0375-b8a0-4242-8512-2176e2810415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.858665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-98dd0375-b8a0-4242-8512-2176e2810415 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:46.859644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-98dd0375-b8a0-4242-8512-2176e2810415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:46.889539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e22e7d-a085-43ec-a36b-2b90a25d79e3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:46.928464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:46.929284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.929557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.929830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.936627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:46.938048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:46.951711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 423/845] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:46.951711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db5a8-3f64-4c80-a8e2-2f8fe2180ae8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.951711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db5a8-3f64-4c80-a8e2-2f8fe2180ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.951711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db5a8-3f64-4c80-a8e2-2f8fe2180ae8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.952616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 424/846] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:46.952720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:46.953539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:46.954453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:46.954893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d400de1-f777-4ed4-82cc-3d6612a6069c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:46.954893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d400de1-f777-4ed4-82cc-3d6612a6069c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:46.954893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d400de1-f777-4ed4-82cc-3d6612a6069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:46.958844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 423/847] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:46.959663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:46.973757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:46.975193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4d400de1-f777-4ed4-82cc-3d6612a6069c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:46.976438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4d400de1-f777-4ed4-82cc-3d6612a6069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:47.047819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 425/848] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:59:47.048808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d400de1-f777-4ed4-82cc-3d6612a6069c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.066800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:47.091012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f392f8-59e2-4c2e-9738-c73d30550967 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.129046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.129799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.130117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.130394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.131166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:47.131474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.132922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.146826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 424/849] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:47.147826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.164295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d400de1-f777-4ed4-82cc-3d6612a6069c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.201240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.202339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.202809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.203221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.213758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:47.221397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:47.222323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:47.223177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 426/850] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:47.223873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.223941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:47.262740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7ee4-476f-4b3a-88e4-a584a0b64f27 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.294144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:47.297540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cc65b-107e-417c-8c1b-e6afe62c6037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.298336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc65b-107e-417c-8c1b-e6afe62c6037 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.298620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc65b-107e-417c-8c1b-e6afe62c6037 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.298895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc65b-107e-417c-8c1b-e6afe62c6037 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.300305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cc65b-107e-417c-8c1b-e6afe62c6037 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.301671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cc65b-107e-417c-8c1b-e6afe62c6037 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-116cc65b-107e-417c-8c1b-e6afe62c6037 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:47.313675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:47.315574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:47.316652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 425/851] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:47.317480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221f8f8-856e-4661-9ef2-c064371314b4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.317480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221f8f8-856e-4661-9ef2-c064371314b4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.317480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221f8f8-856e-4661-9ef2-c064371314b4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.322172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 426/852] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:47.322172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221f8f8-856e-4661-9ef2-c064371314b4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.327794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f54858-6e21-4ac2-8d25-54f89792d1f3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.362134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.363193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.363471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.363740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.364610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7277ec365bac4e9d8a22f63c55bbb908) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:47.364918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.366353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.372067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 427/853] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/role_assignments?user.id=7277ec365bac4e9d8a22f63c55bbb908&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:47.372889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.430041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221f8f8-856e-4661-9ef2-c064371314b4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.465514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:47.472984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdacee-785c-4ab4-ad91-a55b4e7b1cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.473676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdacee-785c-4ab4-ad91-a55b4e7b1cef None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.473959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdacee-785c-4ab4-ad91-a55b4e7b1cef None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.474253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdacee-785c-4ab4-ad91-a55b4e7b1cef None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.474984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdacee-785c-4ab4-ad91-a55b4e7b1cef None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:47.475292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdacee-785c-4ab4-ad91-a55b4e7b1cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.476709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdacee-785c-4ab4-ad91-a55b4e7b1cef None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.483140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e000-16f5-4017-a797-50776c357a4f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.486295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 427/854] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:47.487963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf853948-0993-450b-8765-b1b21a30e53c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.488274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf853948-0993-450b-8765-b1b21a30e53c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.488553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf853948-0993-450b-8765-b1b21a30e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.505606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bf853948-0993-450b-8765-b1b21a30e53c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:47.506820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bf853948-0993-450b-8765-b1b21a30e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:47.526648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.527314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.527597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.527872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.528640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:47.528945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.530397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.532121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:47.536874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 428/855] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:47.537673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.589044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 428/856] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:47.590152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf853948-0993-450b-8765-b1b21a30e53c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.677391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763df43d-2651-492e-bf8b-26ac84ef7f09 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.695786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf853948-0993-450b-8765-b1b21a30e53c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.715344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.716135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.716447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.716725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.720179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:47.728731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.730165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.731990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.732691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.732983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.733243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.733951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:47.734254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.735602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.750368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 429/857] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:47.750368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:47.750661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:47.751725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:47.753717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:47.753717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:47.753717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:47.753717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:47.753717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 429/858] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:47.761517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.828559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:47.870035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ce36-0f92-46b3-9903-a9eca77368d4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.897951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c366e2-d28c-498d-abd3-14a573b45c4a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:47.913090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.914284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.914746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.915285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.915959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.917406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:47.933025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:47.934015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:47.934863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:47.938830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 430/859] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:47.939724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:47.941911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:47.942623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:47.942880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:47.943159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:47.943975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:47.944187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:47.946567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:47.961376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 430/860] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:47.966680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:48.000766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:48.058395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab3d10-3081-4fc1-a867-696c98d5a20d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:48.093970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2639-f03a-491f-a650-c4baf51c7364 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:48.103379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:48.104140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:48.104537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:48.104886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:48.106128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:48.106509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:48.108033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:48.109125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:48.120632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 431/861] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:48.122472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:48.141448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:48.142678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:48.143176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:48.144426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:48.153597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:48.155847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:48.172683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:48.173692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:48.175786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:48.178528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 431/862] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 07:59:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:48.184833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:48.245776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695903-340b-42fd-8a91-f24c8b28ebb3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:48.262879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:48.286234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:48.286952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:48.287177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:48.287453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:48.288158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:48.288497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:48.289858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:48.300223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 432/863] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:48.329370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824da77-66ce-41f7-b84a-3a82d5055b02 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:48.370298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:48.370996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:48.371275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:48.371545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:48.372502 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:48.372807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:48.374301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:48.395414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 432/864] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 07:59:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:48.401611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:48.520220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef757f1a-2e23-4b49-a7c2-5429d8ddacbe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:48.552879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:48.553542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:48.553821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:48.554092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:48.604519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:48.630282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:48.631751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:48.859497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 433/865] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:59:48.864930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:48.896578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:48.977980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef285f1-9227-47ce-a84c-f1e914274aac None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:49.013871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:49.014669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.014951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.015227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.026210 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:49.027676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:49.046315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:49.047233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:49.048135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:49.048135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:49.048135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:49.048135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:49.048135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 433/866] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:49.055124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:49.136656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:49.156833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6d64-6605-4063-bae1-ed7ba5558367 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:49.191892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:49.192950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.193453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.193931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.194849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:49.195389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:49.196962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:49.209183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 434/867] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:49.214890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:49.303398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:49.323673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfdcdc-0ea1-4e5b-8bdd-2648d65cc120 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:49.359652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12418b-f202-4993-8d50-b26fc2e7d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:49.361428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12418b-f202-4993-8d50-b26fc2e7d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.362023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12418b-f202-4993-8d50-b26fc2e7d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.362525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12418b-f202-4993-8d50-b26fc2e7d2c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.369973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12418b-f202-4993-8d50-b26fc2e7d2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:49.371643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12418b-f202-4993-8d50-b26fc2e7d2c1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3d12418b-f202-4993-8d50-b26fc2e7d2c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:49.388535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:49.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:49.390345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 434/868] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:49.398270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:49.508445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c94f-2973-4215-bfac-8e2e1717bfc9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:49.545061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:49.545723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.546000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.546274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.547055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:49.547372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:49.548809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:49.556408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:49.562769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 435/869] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:49.569817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc1213-81c0-46bb-a547-efcd696dcfba None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.570100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc1213-81c0-46bb-a547-efcd696dcfba None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.570384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc1213-81c0-46bb-a547-efcd696dcfba None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.571906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 435/870] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:49.572912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:49.579280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c98c-0c29-4028-8ea5-559bc214eb1e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.579437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c98c-0c29-4028-8ea5-559bc214eb1e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.579652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c98c-0c29-4028-8ea5-559bc214eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.601894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f659c98c-0c29-4028-8ea5-559bc214eb1e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:49.603827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f659c98c-0c29-4028-8ea5-559bc214eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:49.685640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd1ea-61c6-42d0-a279-8d56f9b25946 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:49.696336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 436/871] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:49.717103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c98c-0c29-4028-8ea5-559bc214eb1e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:49.726963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066987-9561-414f-be81-1befb405ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:49.727690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066987-9561-414f-be81-1befb405ef33 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.727981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066987-9561-414f-be81-1befb405ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.728287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066987-9561-414f-be81-1befb405ef33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.729121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95066987-9561-414f-be81-1befb405ef33 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=650f8582a9ce4fc29f1a31e01dd74cbb) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:49.729436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95066987-9561-414f-be81-1befb405ef33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:49.730866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95066987-9561-414f-be81-1befb405ef33 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:49.737210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 436/872] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:49 2022] GET /identity/v3/role_assignments?user.id=650f8582a9ce4fc29f1a31e01dd74cbb&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:49.804588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:49.839698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c98c-0c29-4028-8ea5-559bc214eb1e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:49.878596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d95c7b-9323-4b5b-aaad-9efb0b963a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:49.879417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95c7b-9323-4b5b-aaad-9efb0b963a65 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:49.879686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95c7b-9323-4b5b-aaad-9efb0b963a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:49.879970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95c7b-9323-4b5b-aaad-9efb0b963a65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:49.880667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d95c7b-9323-4b5b-aaad-9efb0b963a65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:49.882042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d95c7b-9323-4b5b-aaad-9efb0b963a65 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e4d95c7b-9323-4b5b-aaad-9efb0b963a65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:49.896231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:49.897264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:49.898355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 437/873] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:49.905736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066987-9561-414f-be81-1befb405ef33 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:49.973079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:50.000778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb12e19-0438-4a74-a521-f1055951ad2c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.001117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb12e19-0438-4a74-a521-f1055951ad2c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.001337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb12e19-0438-4a74-a521-f1055951ad2c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.005381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 438/874] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:50.009931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0a252-2788-42e6-b7fc-0df9941dfb0b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.010222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0a252-2788-42e6-b7fc-0df9941dfb0b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.010505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0a252-2788-42e6-b7fc-0df9941dfb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.020225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066987-9561-414f-be81-1befb405ef33 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:50.032245 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9be0a252-2788-42e6-b7fc-0df9941dfb0b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:50.034255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9be0a252-2788-42e6-b7fc-0df9941dfb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:50.057593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:50.058344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.058917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.059116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.059942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:50.060351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:50.061794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:50.068224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 437/875] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 07:59:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:50.073959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:50.123916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 439/876] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:59:50.149330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0a252-2788-42e6-b7fc-0df9941dfb0b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:50.194804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c5e0f-3e56-4c12-bf6f-5b7d1e1774ac None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:50.222790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:50.226829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:50.233576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3345a2-6365-4a23-993e-0e04733f2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:50.234422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3345a2-6365-4a23-993e-0e04733f2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.234846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3345a2-6365-4a23-993e-0e04733f2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.238161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3345a2-6365-4a23-993e-0e04733f2ed8 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.238161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3345a2-6365-4a23-993e-0e04733f2ed8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:50.238161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3345a2-6365-4a23-993e-0e04733f2ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:50.239145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3345a2-6365-4a23-993e-0e04733f2ed8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:50.253196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 438/877] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 07:59:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:50.272187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0a252-2788-42e6-b7fc-0df9941dfb0b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:50.313170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174850a-e210-4da7-a064-c66c806db04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:50.313911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174850a-e210-4da7-a064-c66c806db04c None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.314193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174850a-e210-4da7-a064-c66c806db04c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.314468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174850a-e210-4da7-a064-c66c806db04c None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.316142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174850a-e210-4da7-a064-c66c806db04c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:50.317276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174850a-e210-4da7-a064-c66c806db04c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:50.425682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 440/878] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:59:50 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:59:50.478290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b68fd-2a5f-4e16-9be3-642c1238c57b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.478594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b68fd-2a5f-4e16-9be3-642c1238c57b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.478762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b68fd-2a5f-4e16-9be3-642c1238c57b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.480535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 439/879] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:50.486210 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5e87-3878-46e7-94d4-d59f4387de7b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.486525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5e87-3878-46e7-94d4-d59f4387de7b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.487399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5e87-3878-46e7-94d4-d59f4387de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.505647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-65eb5e87-3878-46e7-94d4-d59f4387de7b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:50.506850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-65eb5e87-3878-46e7-94d4-d59f4387de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:50.589750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 441/880] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:50.613862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b68fd-2a5f-4e16-9be3-642c1238c57b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:50.726954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b68fd-2a5f-4e16-9be3-642c1238c57b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:50.763161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e84629-4ee1-4839-b64c-ccefabb6a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:50.764146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84629-4ee1-4839-b64c-ccefabb6a95d None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:50.764671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84629-4ee1-4839-b64c-ccefabb6a95d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:50.765144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84629-4ee1-4839-b64c-ccefabb6a95d None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:50.766098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e84629-4ee1-4839-b64c-ccefabb6a95d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:50.767717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e84629-4ee1-4839-b64c-ccefabb6a95d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:50.888278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 440/881] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:59:50 2022] POST /identity/v3/services => generated 269 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:51.910014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938951-e784-49de-8e90-a98740f7bdf2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:51.910951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938951-e784-49de-8e90-a98740f7bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:51.911454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938951-e784-49de-8e90-a98740f7bdf2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:51.913328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 442/882] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:51.921448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6319-ed76-42d2-ba4a-50072191d51c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:51.922266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6319-ed76-42d2-ba4a-50072191d51c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:51.922741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6319-ed76-42d2-ba4a-50072191d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:51.942345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-26fc6319-ed76-42d2-ba4a-50072191d51c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:51.943890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-26fc6319-ed76-42d2-ba4a-50072191d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:51.994152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:52.023714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 441/883] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:52.048301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d938951-e784-49de-8e90-a98740f7bdf2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:52.105354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:52.160220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d938951-e784-49de-8e90-a98740f7bdf2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:52.195811 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f69d30-3a5d-437f-884b-4ab79a4c25f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:52.196649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f69d30-3a5d-437f-884b-4ab79a4c25f3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.196931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f69d30-3a5d-437f-884b-4ab79a4c25f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.197208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f69d30-3a5d-437f-884b-4ab79a4c25f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.208950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f69d30-3a5d-437f-884b-4ab79a4c25f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-23f69d30-3a5d-437f-884b-4ab79a4c25f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:52.217114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:52.218048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:52.218897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 443/884] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 07:59:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:52.225625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6319-ed76-42d2-ba4a-50072191d51c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:52.331407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6319-ed76-42d2-ba4a-50072191d51c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:52.362868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd321e14-80c8-41d3-89f0-52422c1c8e12 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.363165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd321e14-80c8-41d3-89f0-52422c1c8e12 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.363483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd321e14-80c8-41d3-89f0-52422c1c8e12 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.368317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 444/885] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:52.369400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:52.370199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e35940-bc75-41c0-abe1-9ae3d8ef666f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.370493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e35940-bc75-41c0-abe1-9ae3d8ef666f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.370598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.370772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e35940-bc75-41c0-abe1-9ae3d8ef666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.371218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.371661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.372604 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:52.373083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:52.374601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:52.386125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 442/886] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 07:59:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:52.390642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-29e35940-bc75-41c0-abe1-9ae3d8ef666f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:52.390642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-29e35940-bc75-41c0-abe1-9ae3d8ef666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:52.392103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:52.446831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:52.464720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 445/887] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:52.488914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e35940-bc75-41c0-abe1-9ae3d8ef666f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:52.527466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873fcf8-5d1f-4dcc-b67e-8655c757d722 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:52.533516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:52.589213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:52.590907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.591337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.591755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.602915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e35940-bc75-41c0-abe1-9ae3d8ef666f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:52.606368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:52.608177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:52.626481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:52.627963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:52.628900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:52.628900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:52.628900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:52.628900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:52.631263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 443/888] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:52.640245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:52.644371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25dd8e-656a-4cd3-9b19-baab0a85173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:52.645175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25dd8e-656a-4cd3-9b19-baab0a85173f None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.645458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25dd8e-656a-4cd3-9b19-baab0a85173f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.645727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25dd8e-656a-4cd3-9b19-baab0a85173f None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.646452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25dd8e-656a-4cd3-9b19-baab0a85173f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:52.648074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25dd8e-656a-4cd3-9b19-baab0a85173f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:52.725537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 446/889] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 07:59:52 2022] POST /identity/v3/services => generated 241 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:52.726657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0cc1-440b-4a0f-aa92-8208fa5204e3 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.726946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0cc1-440b-4a0f-aa92-8208fa5204e3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.727228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0cc1-440b-4a0f-aa92-8208fa5204e3 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.728660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 447/890] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:52.734333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0a30-d41d-4df4-b30a-95c978503214 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.734637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0a30-d41d-4df4-b30a-95c978503214 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.734957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0a30-d41d-4df4-b30a-95c978503214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.743412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:52.759474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cf1f0a30-d41d-4df4-b30a-95c978503214 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:52.760446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cf1f0a30-d41d-4df4-b30a-95c978503214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:52.764586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9e793-d5f6-406d-a2a4-4f4d0166b65c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:52.827074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:52.828657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:52.829396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:52.829852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:52.831509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:52.833700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:52.835552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:52.852063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 444/891] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:52.852757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 448/892] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:52.862529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:52.869894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f0a30-d41d-4df4-b30a-95c978503214 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:52.911220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:52.979329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830efbb9-0aac-44b6-ba09-725372fddc6a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.008117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f0a30-d41d-4df4-b30a-95c978503214 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.024498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacebbfa-de8a-4298-bc62-8ffec8bcb90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.025745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacebbfa-de8a-4298-bc62-8ffec8bcb90d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.026097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacebbfa-de8a-4298-bc62-8ffec8bcb90d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.026370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacebbfa-de8a-4298-bc62-8ffec8bcb90d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.034911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacebbfa-de8a-4298-bc62-8ffec8bcb90d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.036561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacebbfa-de8a-4298-bc62-8ffec8bcb90d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.048361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.049674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.050112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.050417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.051073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.052459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-dacebbfa-de8a-4298-bc62-8ffec8bcb90d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:53.054824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:53.055743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:53.057139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:53.060345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 445/893] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 07:59:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:53.061910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504dd46-9214-4174-88cd-a39b363cc2c1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.062207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504dd46-9214-4174-88cd-a39b363cc2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.062488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504dd46-9214-4174-88cd-a39b363cc2c1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.063903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 446/894] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:53.065685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:53.066648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:53.067513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 449/895] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:53.068998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504dd46-9214-4174-88cd-a39b363cc2c1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.072412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.080399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.173581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.181143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6390-4733-4f1f-a8a4-65572f6f5c44 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.182757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504dd46-9214-4174-88cd-a39b363cc2c1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.220583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd739a96-e7d1-4390-87a5-89149a186c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.221011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.221817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd739a96-e7d1-4390-87a5-89149a186c29 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.222106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd739a96-e7d1-4390-87a5-89149a186c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.222426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.222595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd739a96-e7d1-4390-87a5-89149a186c29 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.222760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.222986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.223290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd739a96-e7d1-4390-87a5-89149a186c29 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:53.223601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd739a96-e7d1-4390-87a5-89149a186c29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.223826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:53.224137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.224990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd739a96-e7d1-4390-87a5-89149a186c29 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.225578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.230852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 450/896] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:53.232108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0c79-06c1-4356-8055-fdb823fea4a0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.232423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0c79-06c1-4356-8055-fdb823fea4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.232706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0c79-06c1-4356-8055-fdb823fea4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.249201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 447/897] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:53.250114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.258976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a39a0c79-06c1-4356-8055-fdb823fea4a0 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:53.260275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a39a0c79-06c1-4356-8055-fdb823fea4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:53.316795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.335313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 451/898] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:53.341112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0c79-06c1-4356-8055-fdb823fea4a0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.364132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649d31f-adcc-4ae2-a234-59ce69e2e58b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.401383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.402033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.402334 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.402612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.403328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:53.403623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.405022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.410315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 448/899] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:53.415569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.436740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.449726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0c79-06c1-4356-8055-fdb823fea4a0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.489149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.489732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.490013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.490292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.524937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521ec7-8ed7-4ac9-b320-ff0732b792ca None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.553978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.563805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.568077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.568274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.568386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.568386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.568386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.568620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.568897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:53.586165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:53.587306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:53.593159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 449/900] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:53.594046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.658451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.671605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 452/901] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:59:53.672613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.710159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bb445-62da-418f-8dd0-f89454b4845a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.746048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.746639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.746921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.747322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.748127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] RBAC: Adding query filter params (interface=public, service_id=ec809d8cf11c49dabb35df0841806158, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:53.748469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.749983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.760343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 450/902] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/endpoints?service_id=ec809d8cf11c49dabb35df0841806158&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:53.760343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.778322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7555-92cc-40dd-acbe-1e34bd3baed1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.818813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.820311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.821049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.821412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.821764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.822549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:53.822946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.824354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.833993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 453/903] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:53.833993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.871345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b838c-75e1-409a-a7a2-f69e13cb12ab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.891859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:53.915657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.916502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.916786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.917057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.930382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.931825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.949417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12c759-dae8-46fa-8255-188aa2210042 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:53.950688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:53.951689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:53.952613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:53.952613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:53.952613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:53.952613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:53.954193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 451/904] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:53.955114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:53.987178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:53.987885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:53.988307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:53.988568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:53.989281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:53.990633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:53.996778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 454/905] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:59:53.997500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:54.083911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e80c6-5e12-4139-9a87-ad344944cd00 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:54.095331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:54.123963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:54.124895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.125277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.125937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.127009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:54.128302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:54.129659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e85a5-a187-494f-938f-22ce1170f69b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:54.130288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:54.140235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 452/906] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:54.142333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:54.156417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:54.183703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:54.183703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.184019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.184661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.185496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:54.186319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:54.188062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:54.204584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 455/907] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:54.210900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:54.277115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95c98-8e0b-4dbb-949a-939c63ca9cfb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:54.307375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:54.311945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.311945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.311945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.311945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] RBAC: Adding query filter params (interface=public, service_id=75936d916d914b58b2f4a2ea1831632e, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:54.311945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:54.312450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:54.320270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 453/908] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 07:59:54 2022] GET /identity/v3/endpoints?service_id=75936d916d914b58b2f4a2ea1831632e&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:54.324978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:54.342927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6308fc8-cc3f-49ff-9383-5870ee3d2891 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:54.375558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:54.388372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:54.391943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.391943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.391943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.400484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:54.402651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:54.422294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:54.423274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:54.424279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:54.426681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 456/909] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:54.431541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:54.460953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acc156-20a2-45cd-9d0f-256e7404fed3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:54.468720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:54.500528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:54.501552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.502150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.502672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.503566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:54.505265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:54.518549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 454/910] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 07:59:54 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:59:54.543217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08e37f-c28d-4b2b-81b0-37341d364d65 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:54.587526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a3d5d-840e-4773-b2a3-156559840a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:54.588509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3d5d-840e-4773-b2a3-156559840a84 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.588934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3d5d-840e-4773-b2a3-156559840a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.589608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3d5d-840e-4773-b2a3-156559840a84 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.590554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a3d5d-840e-4773-b2a3-156559840a84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:54.591006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a3d5d-840e-4773-b2a3-156559840a84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:54.592652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a3d5d-840e-4773-b2a3-156559840a84 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:54.609853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 457/911] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:54.616283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:54.728527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:54.731512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df2e93-7081-496d-8ccf-b98f25400d8f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:54.766840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50270e01-4634-48d3-aa8f-99934a38f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:54.767503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50270e01-4634-48d3-aa8f-99934a38f758 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.767791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50270e01-4634-48d3-aa8f-99934a38f758 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.768669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50270e01-4634-48d3-aa8f-99934a38f758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.769600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50270e01-4634-48d3-aa8f-99934a38f758 None admin] RBAC: Adding query filter params (role.id=32e446f6c32f4fb9a9cbedd10ef67bdf, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=650f8582a9ce4fc29f1a31e01dd74cbb) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:54.769920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50270e01-4634-48d3-aa8f-99934a38f758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:54.771363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50270e01-4634-48d3-aa8f-99934a38f758 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:54.778101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 455/912] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 07:59:54 2022] GET /identity/v3/role_assignments?user.id=650f8582a9ce4fc29f1a31e01dd74cbb&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=32e446f6c32f4fb9a9cbedd10ef67bdf => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:54.873734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a93f-4d36-41e2-83cb-0d3451a9a54e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.874043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a93f-4d36-41e2-83cb-0d3451a9a54e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.874208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a93f-4d36-41e2-83cb-0d3451a9a54e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.875948 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 458/913] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:54.882240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f77c5-a7fe-4232-8090-6d299c91e375 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:54.882569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f77c5-a7fe-4232-8090-6d299c91e375 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:54.882835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f77c5-a7fe-4232-8090-6d299c91e375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:54.902733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f22f77c5-a7fe-4232-8090-6d299c91e375 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:54.903962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f22f77c5-a7fe-4232-8090-6d299c91e375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:54.980336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 456/914] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:55.003795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a93f-4d36-41e2-83cb-0d3451a9a54e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:55.113179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:55.120064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a93f-4d36-41e2-83cb-0d3451a9a54e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:55.156670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:55.157393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:55.157675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:55.157951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:55.158632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:55.159999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:55.172717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:55.173706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:55.175186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 459/915] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:55.180276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f77c5-a7fe-4232-8090-6d299c91e375 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:55.287825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:55.301613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f77c5-a7fe-4232-8090-6d299c91e375 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:55.337282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:55.337993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:55.338278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:55.338553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:55.339316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:55.339625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:55.341145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:55.346570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 457/916] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 07:59:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:55.353379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:55.458356 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842ea29-4bda-4e2e-a2dd-cfc6cd95d29e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:55.495224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:55.496244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:55.496721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:55.497181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:55.498084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:55.498582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:55.500120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:55.506229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 460/917] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 07:59:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:55.513327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:55.626102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88721c75-e6ac-402b-9ded-6323758c5899 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:55.663371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6c27-8ca0-4410-8348-252aa3d62207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:55.664033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6c27-8ca0-4410-8348-252aa3d62207 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:55.664349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6c27-8ca0-4410-8348-252aa3d62207 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:55.664634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6c27-8ca0-4410-8348-252aa3d62207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:55.665427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6c27-8ca0-4410-8348-252aa3d62207 None admin] RBAC: Adding query filter params (interface=public, service_id=abdea21d7b1f43619e48aeac31856f46, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:55.665742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6c27-8ca0-4410-8348-252aa3d62207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:55.667114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6c27-8ca0-4410-8348-252aa3d62207 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:55.672688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 458/918] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 07:59:55 2022] GET /identity/v3/endpoints?service_id=abdea21d7b1f43619e48aeac31856f46&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:55.678847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:55.705871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:55.787976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d480-90ed-45d7-973c-08fc7bfd3f73 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:55.827532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10a186-e85e-4bed-99b0-172bf3430162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:55.828205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a186-e85e-4bed-99b0-172bf3430162 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:55.828493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a186-e85e-4bed-99b0-172bf3430162 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:55.828770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a186-e85e-4bed-99b0-172bf3430162 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:55.829445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10a186-e85e-4bed-99b0-172bf3430162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:55.831403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10a186-e85e-4bed-99b0-172bf3430162 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:55.837969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 461/919] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 07:59:55 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:59:56.200047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6a73-899a-4257-af19-9b3aab15d422 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:56.201086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6a73-899a-4257-af19-9b3aab15d422 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:56.201585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6a73-899a-4257-af19-9b3aab15d422 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:56.203420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 459/920] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:56.208827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf319cf-fe6d-4d7a-a2f2-47be47d9655b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:56.209641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf319cf-fe6d-4d7a-a2f2-47be47d9655b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:56.210152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf319cf-fe6d-4d7a-a2f2-47be47d9655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:56.227106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cdf319cf-fe6d-4d7a-a2f2-47be47d9655b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:56.228628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cdf319cf-fe6d-4d7a-a2f2-47be47d9655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:56.305212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 462/921] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:56.328649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d6a73-899a-4257-af19-9b3aab15d422 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:56.355442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:56.438075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d6a73-899a-4257-af19-9b3aab15d422 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:56.474169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:56.475323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:56.475811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:56.476353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:56.477341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:56.478967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:56.492380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:56.493502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 07:59:56.494446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:56.497417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 460/922] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:56.503626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf319cf-fe6d-4d7a-a2f2-47be47d9655b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:56.528798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:56.631196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf319cf-fe6d-4d7a-a2f2-47be47d9655b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:56.667468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e62b7-3c4f-4d9c-80d7-cb5e2d3d4bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:56.668126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e62b7-3c4f-4d9c-80d7-cb5e2d3d4bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:56.668434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e62b7-3c4f-4d9c-80d7-cb5e2d3d4bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:56.668706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e62b7-3c4f-4d9c-80d7-cb5e2d3d4bd3 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:56.669409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e62b7-3c4f-4d9c-80d7-cb5e2d3d4bd3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:56.669709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e62b7-3c4f-4d9c-80d7-cb5e2d3d4bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:56.671056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e62b7-3c4f-4d9c-80d7-cb5e2d3d4bd3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:56.677532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 463/923] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:56.685578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:56.777208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:56.778467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b299-7a38-4d93-a9ec-9c3ffcc54c46 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:56.778888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b299-7a38-4d93-a9ec-9c3ffcc54c46 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:56.779262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b299-7a38-4d93-a9ec-9c3ffcc54c46 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:56.780903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 464/924] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:56.787029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275b98a-1218-4ad6-8048-0b026277e56b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:56.787411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275b98a-1218-4ad6-8048-0b026277e56b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:56.787749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275b98a-1218-4ad6-8048-0b026277e56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:56.793845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f3395-aadd-47c3-be61-e74e5f72ea97 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:56.805258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e275b98a-1218-4ad6-8048-0b026277e56b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:56.806545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e275b98a-1218-4ad6-8048-0b026277e56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:56.834180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:56.834948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:56.835343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:56.835631 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:56.836372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:56.836686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:56.838250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:56.843939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 461/925] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 07:59:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:56.853306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:56.882164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 465/926] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:59:56.905983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275b98a-1218-4ad6-8048-0b026277e56b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:56.921757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:56.979018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7053ed-e4f7-42ac-b1dc-fef9042a0f27 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.023519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275b98a-1218-4ad6-8048-0b026277e56b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.025152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295a0b-7649-45e4-8c4e-795e27b1780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.026447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295a0b-7649-45e4-8c4e-795e27b1780b None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.026447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295a0b-7649-45e4-8c4e-795e27b1780b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.026447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295a0b-7649-45e4-8c4e-795e27b1780b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.027204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7295a0b-7649-45e4-8c4e-795e27b1780b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:57.028640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7295a0b-7649-45e4-8c4e-795e27b1780b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:57.058300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49d53e-1490-4bfe-9479-da514f241593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.059094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49d53e-1490-4bfe-9479-da514f241593 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.059371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49d53e-1490-4bfe-9479-da514f241593 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.059637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49d53e-1490-4bfe-9479-da514f241593 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.060305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49d53e-1490-4bfe-9479-da514f241593 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:57.061649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49d53e-1490-4bfe-9479-da514f241593 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-de49d53e-1490-4bfe-9479-da514f241593 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:57.073926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:57.075087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:57.075942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 466/927] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 07:59:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:57.077164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595102f-64d1-462f-a063-1819ecc3780d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.077164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595102f-64d1-462f-a063-1819ecc3780d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.077164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595102f-64d1-462f-a063-1819ecc3780d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.078162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 467/928] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:59:57.081444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595102f-64d1-462f-a063-1819ecc3780d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:57.124345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 462/929] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 07:59:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:59:57.124345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e073b6-77a1-441b-b3df-140f6cd00100 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.124345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e073b6-77a1-441b-b3df-140f6cd00100 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.124345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e073b6-77a1-441b-b3df-140f6cd00100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.148280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:57.153382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e7e073b6-77a1-441b-b3df-140f6cd00100 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:57.155029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e7e073b6-77a1-441b-b3df-140f6cd00100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:57.168280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:57.201382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595102f-64d1-462f-a063-1819ecc3780d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.240381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.241023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.241470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.241590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.241736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 463/930] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:57.243569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:57.243569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:57.243954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:57.249803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 468/931] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:57.256747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e073b6-77a1-441b-b3df-140f6cd00100 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:57.266347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:57.376230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e073b6-77a1-441b-b3df-140f6cd00100 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.401911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc7b8-3d43-4056-aff0-1b1cc081effc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.419521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.420272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.420641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.420829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.421537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:57.421845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:57.423216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:57.425555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:57.429702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 464/932] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:57.435231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:57.449091 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.450318 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.450599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.450873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.454696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:57.466021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:59:57.477840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:57.479027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 07:59:57.480121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:57.484302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 469/933] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 07:59:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:57.486151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:57.568786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a80fd-8894-4962-9785-f9f003100e4e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.604704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.605288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.605568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.605841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.606577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:57.607930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:57.615786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa2a12-fa8f-4d51-9621-5ff986043467 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.652920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.653875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.654356 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.654839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.655785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:57.656385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:57.657927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:57.667154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 470/934] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 07:59:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:57.673007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:57.740896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 465/935] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 07:59:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:59:57.747865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:57.793083 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683ae0c-4f59-4746-a79d-c753fb8ec085 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:57.839561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c025-c7b6-4b5c-aaef-8e0af06c7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:57.840458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c025-c7b6-4b5c-aaef-8e0af06c7ccc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.840748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c025-c7b6-4b5c-aaef-8e0af06c7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.841079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c025-c7b6-4b5c-aaef-8e0af06c7ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.857527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5c025-c7b6-4b5c-aaef-8e0af06c7ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:57.860106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5c025-c7b6-4b5c-aaef-8e0af06c7ccc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e6b5c025-c7b6-4b5c-aaef-8e0af06c7ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:57.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:57.882000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:57.882946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:57.882946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:57.882946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:57.882946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:57.882946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 471/936] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:57.893410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:57.957101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:57.989257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41a12-eeb1-437f-bc79-ede7d4139dd1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.989592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41a12-eeb1-437f-bc79-ede7d4139dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.989817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41a12-eeb1-437f-bc79-ede7d4139dd1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:57.991226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 472/937] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:57.997405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b210-88a8-48de-8075-89a3c23d6475 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:57.998028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b210-88a8-48de-8075-89a3c23d6475 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:57.998308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4b210-88a8-48de-8075-89a3c23d6475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.008890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676342e-6471-4b9b-be99-89d671689d4d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.017387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d1b4b210-88a8-48de-8075-89a3c23d6475 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:58.022038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d1b4b210-88a8-48de-8075-89a3c23d6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:58.044850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.046491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.046773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.047047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.047765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:58.048073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.050027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.066625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 466/938] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:58.072313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.100727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 473/939] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:59:58.123636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4b210-88a8-48de-8075-89a3c23d6475 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.159283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:58.181653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424ede2-d38c-4151-ac32-b52dc2bf314c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.199495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:58.217906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.218647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.218928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.219202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.227648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.229111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.231365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4b210-88a8-48de-8075-89a3c23d6475 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:59:58.244908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:58.246458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 07:59:58.247599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:58.250965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 467/940] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:58.251905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.275369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.276906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.277346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.277765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.278665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.281962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:58.296316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:58.297574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 07:59:58.298566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:58.301228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 474/941] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:59:58.307276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.374972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898060-b3f8-46b3-9018-fd38f5492ba9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.412570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.413257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.413539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.413815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.414673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:58.414984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.416479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.430143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:58.434623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6780a1-386b-4f93-a637-82b858d0634b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.439638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 468/942] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:58.440926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.483046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:58.484413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.485223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.485408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.485517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.486236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:58.486539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.488130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.497957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 475/943] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:58.505580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.559041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b384-2b32-4229-9d3c-3ec3d467770f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.594961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.595766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.596030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.596894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.607815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.609364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.615622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1942c-cbb4-4d61-bcf2-3a81ae8ba0f0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:59:58.627296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:58.629046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:58.630003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:59:58.630003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:59:58.630003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:59:58.630003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:58.633971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 469/944] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:58.634819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.654845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.655760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.656254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.656710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.657702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:58.658183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.659745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.665459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 476/945] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:59:58.670974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.728068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:58.743859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:58.744017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9d5b-0c71-4516-97ad-dd37f80f2d3a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.791219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.792686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.793173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.793949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.795094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:58.795948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.797997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.804540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93ef7-556b-4b49-9e59-2263162b2a32 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.815444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 470/946] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:58.821980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:58.852675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.853748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.854033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.854309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.855316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:58.856956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:58.935991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfb449-5644-4956-8df2-6d98a7617e12 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:58.952593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 477/947] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 07:59:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:59:58.989463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:58.990287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:58.990575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:58.990845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:58.998977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:59.000459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:59.016969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:59.017954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.019318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 471/948] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:59.025359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:59.124130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:59.141286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758dc68-f19e-43f9-89af-2935663704bd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:59.176586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f05eab-5caf-420d-9624-873b5fcfd461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:59.177246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05eab-5caf-420d-9624-873b5fcfd461 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.177530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05eab-5caf-420d-9624-873b5fcfd461 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.177809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05eab-5caf-420d-9624-873b5fcfd461 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.178597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f05eab-5caf-420d-9624-873b5fcfd461 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:59:59.178906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f05eab-5caf-420d-9624-873b5fcfd461 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:59.180426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f05eab-5caf-420d-9624-873b5fcfd461 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:59.193888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 478/949] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 07:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:59:59.199835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:59.203013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:59.311382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc831b-ed94-4aeb-8336-f73eafdb088a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:59.353299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:59.354187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.354463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.354735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/650f8582a9ce4fc29f1a31e01dd74cbb/roles/32e446f6c32f4fb9a9cbedd10ef67bdf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.356967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=650f8582a9ce4fc29f1a31e01dd74cbb, role_id=32e446f6c32f4fb9a9cbedd10ef67bdf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:59.358392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:59.444832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c1e74-d107-43a4-8a3b-2abd73e554f6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.445356 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c1e74-d107-43a4-8a3b-2abd73e554f6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.445432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c1e74-d107-43a4-8a3b-2abd73e554f6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.447039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 479/950] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:59.451728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02694-a956-424b-abbc-a25633257146 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.452010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02694-a956-424b-abbc-a25633257146 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.452451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02694-a956-424b-abbc-a25633257146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.461422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 472/951] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 07:59:59 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/650f8582a9ce4fc29f1a31e01dd74cbb/roles/32e446f6c32f4fb9a9cbedd10ef67bdf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:59:59.470591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b3e02694-a956-424b-abbc-a25633257146 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:59.471863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b3e02694-a956-424b-abbc-a25633257146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:59.550250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 480/952] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:59:59.574347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:59.644150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:59.685182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6de04-c149-4891-bc08-c4f3ac4192ac None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:59.721828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:59.722495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.722777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.723053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.723777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:59.725231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:59.726597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING keystone.server.flask.common [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 07:59:59.783281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.sql.core [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 07:59:59.783281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 07:59:59.783281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [parameters: {'id': '786c388366b0400490e26538f837f6df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 07:59:59.783281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6a7265eb-f8e9-4a9c-839a-8802baf70732 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 786c388366b0400490e26538f837f6df.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 786c388366b0400490e26538f837f6df. Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 07:59:59.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 07:59:59.801798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application yield resource Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise self.value Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application session.commit() Jun 24 07:59:59.802754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.flush() Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application compat.raise_( Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 07:59:59.804299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 07:59:59.805213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 07:59:59.805997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [parameters: {'id': '786c388366b0400490e26538f837f6df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:59.806873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:59.809157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 786c388366b0400490e26538f837f6df. Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 07:59:59.811379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 473/953] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Jun 24 07:59:59 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:59.812980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02694-a956-424b-abbc-a25633257146 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:59:59.887955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:59:59.913646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02694-a956-424b-abbc-a25633257146 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:59:59.941454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a3bb4-1e56-40e2-a312-b04415c9372b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.941744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a3bb4-1e56-40e2-a312-b04415c9372b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.942048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a3bb4-1e56-40e2-a312-b04415c9372b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.950194 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 474/954] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 07:59:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:59:59.951014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:59:59.951872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2a60-60e7-4801-bd67-c05cd5a6f007 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.952163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2a60-60e7-4801-bd67-c05cd5a6f007 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.952323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:59:59.952471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2a60-60e7-4801-bd67-c05cd5a6f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.952886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:59:59.953303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:59:59.962132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:59:59.963604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:59:59.972824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-21cf2a60-60e7-4801-bd67-c05cd5a6f007 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:59:59.974640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-21cf2a60-60e7-4801-bd67-c05cd5a6f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:59:59.978473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:59:59.979495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 481/955] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 07:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:59:59.985853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:00.056308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 475/956] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 07:59:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:00.073114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2a60-60e7-4801-bd67-c05cd5a6f007 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:00.107418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35471d1-4b6f-4322-abc9-dd5ea9288b3c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:00.131678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:00.153424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:00.154584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:00.155846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:00.156387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:00.157384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:00.157894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:00.160295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:00.162629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:00.192247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 482/957] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 07:59:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:00.196392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2a60-60e7-4801-bd67-c05cd5a6f007 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:00.235040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:00.235848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:00.236132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:00.236460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:00.237818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:00.239391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:00.252566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:00.253847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:00.254745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:00.259158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 476/958] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:00:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:00.260657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:00.377664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9c563-652d-4cb1-82d7-526bc0698215 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:00.417236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82228f-72b1-4211-978a-05542245d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:00.418245 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82228f-72b1-4211-978a-05542245d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:00.418745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82228f-72b1-4211-978a-05542245d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:00.419221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82228f-72b1-4211-978a-05542245d1b3 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:00.420089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82228f-72b1-4211-978a-05542245d1b3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:00.420432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82228f-72b1-4211-978a-05542245d1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:00.421785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82228f-72b1-4211-978a-05542245d1b3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:00.427553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 483/959] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 08:00:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:00.433023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:00.540494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1859f-3036-453c-abd5-bc1deb7a6a47 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:00.554183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:00.575946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e77d8d-5035-4e3e-9459-f12cbd10c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:00.577086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e77d8d-5035-4e3e-9459-f12cbd10c863 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:00.577375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e77d8d-5035-4e3e-9459-f12cbd10c863 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:00.577652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e77d8d-5035-4e3e-9459-f12cbd10c863 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:00.578364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e77d8d-5035-4e3e-9459-f12cbd10c863 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:00.578673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e77d8d-5035-4e3e-9459-f12cbd10c863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:00.580291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e77d8d-5035-4e3e-9459-f12cbd10c863 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:00.586413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 477/960] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 08:00:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:01.098067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1317b4-c982-4e3a-a1b3-5ef028fe70c2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.098589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1317b4-c982-4e3a-a1b3-5ef028fe70c2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.098668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1317b4-c982-4e3a-a1b3-5ef028fe70c2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.100283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 484/961] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:01.105562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec5ed8-f03e-407f-8a19-d8a9926224c6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.105851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec5ed8-f03e-407f-8a19-d8a9926224c6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.106133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec5ed8-f03e-407f-8a19-d8a9926224c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.123432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-39ec5ed8-f03e-407f-8a19-d8a9926224c6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:01.124646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-39ec5ed8-f03e-407f-8a19-d8a9926224c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:01.196218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 478/962] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:01.219521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1317b4-c982-4e3a-a1b3-5ef028fe70c2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:01.282793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:01.333130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1317b4-c982-4e3a-a1b3-5ef028fe70c2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:01.369658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:01.370387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.370674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.370977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.371641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:01.373062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:01.386666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:01.387722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:01.388604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 485/963] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 08:00:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:01.393860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec5ed8-f03e-407f-8a19-d8a9926224c6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:01.494907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec5ed8-f03e-407f-8a19-d8a9926224c6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:01.505274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:01.538103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbcbb4-7729-4e38-b680-c43580d076d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:01.538768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbcbb4-7729-4e38-b680-c43580d076d2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.539052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbcbb4-7729-4e38-b680-c43580d076d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.539331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbcbb4-7729-4e38-b680-c43580d076d2 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.540041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbcbb4-7729-4e38-b680-c43580d076d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:01.540382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbcbb4-7729-4e38-b680-c43580d076d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:01.541747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbcbb4-7729-4e38-b680-c43580d076d2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:01.546965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 479/964] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 08:00:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:01.552910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:01.636507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c931-cbb7-4c57-b802-7d9d452e0f82 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.636710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c931-cbb7-4c57-b802-7d9d452e0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.636959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c931-cbb7-4c57-b802-7d9d452e0f82 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.641939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 480/965] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:01.643608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0971f-4353-4bd3-8b8b-c3be33a6ed99 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.643886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0971f-4353-4bd3-8b8b-c3be33a6ed99 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.644154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0971f-4353-4bd3-8b8b-c3be33a6ed99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.668173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-afe0971f-4353-4bd3-8b8b-c3be33a6ed99 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:01.669387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-afe0971f-4353-4bd3-8b8b-c3be33a6ed99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:01.679008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01921c3f-045c-41a9-bd00-448741c0c89c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:01.704317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:01.718048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:01.718687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.719825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.719825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.720220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:01.720595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:01.722606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:01.728042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 486/966] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 08:00:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:01.734311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:01.763148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 481/967] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:01.787093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0971f-4353-4bd3-8b8b-c3be33a6ed99 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:01.855293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20da0-2d1c-44ca-9989-a7a62ffc209a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:01.903415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:01.904032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.904396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.904680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.905806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] RBAC: Adding query filter params (interface=admin, service_id=abdea21d7b1f43619e48aeac31856f46, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:01.906125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:01.908116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:01.909790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:01.912480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0971f-4353-4bd3-8b8b-c3be33a6ed99 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:01.921690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 487/968] 10.222.0.42 () {56 vars in 1249 bytes} [Fri Jun 24 08:00:01 2022] GET /identity/v3/endpoints?service_id=abdea21d7b1f43619e48aeac31856f46&interface=admin®ion_id=RegionOne => generated 193 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:01.922579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:01.949479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:01.950634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:01.951103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:01.951562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:01.963855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:01.972877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:01.973863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:01.974757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:01.979117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 482/969] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 08:00:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:01.980480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:01.994283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:02.066003 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b555a-209e-498c-b732-0d71412fbb52 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.095790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d785-1605-4c6f-9d4c-6f27d6872001 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.103107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:02.104921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.105438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.105936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.107285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:02.109594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:02.118418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 488/970] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 08:00:01 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:00:02.140838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:02.141933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.142426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.142910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.144496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:02.145116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:02.146800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:02.157679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 483/971] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 08:00:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:02.163601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:02.277703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdeed-ac82-4add-80c6-3f6c5a908092 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.297548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:02.318012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76b2fa-c572-4dbf-91b1-988edfb54212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:02.318815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76b2fa-c572-4dbf-91b1-988edfb54212 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.319101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76b2fa-c572-4dbf-91b1-988edfb54212 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.319419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76b2fa-c572-4dbf-91b1-988edfb54212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.330988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76b2fa-c572-4dbf-91b1-988edfb54212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:02.332702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76b2fa-c572-4dbf-91b1-988edfb54212 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-be76b2fa-c572-4dbf-91b1-988edfb54212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:02.352446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:02.353416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:02.354341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:02.354341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:02.354341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:02.354341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:02.358413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 489/972] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:02.359847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:02.390869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:02.460087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f43b5-ec2a-4700-8e2f-f2b752d0b4ae None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.460412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f43b5-ec2a-4700-8e2f-f2b752d0b4ae None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.460586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f43b5-ec2a-4700-8e2f-f2b752d0b4ae None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.462328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 490/973] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:02.468237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e014-5e6e-48e0-a7e5-d51ea5d2fda5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.468770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e014-5e6e-48e0-a7e5-d51ea5d2fda5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.469274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e014-5e6e-48e0-a7e5-d51ea5d2fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.477154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c894c78-e79f-40bd-bc3e-c411cffa8ca1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.487225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0b60e014-5e6e-48e0-a7e5-d51ea5d2fda5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:02.488808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0b60e014-5e6e-48e0-a7e5-d51ea5d2fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:02.513863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:02.514540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.514818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.515099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.515827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:02.516138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:02.517621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:02.536231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 484/974] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:02.537563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:02.582426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 491/975] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:02.601812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60e014-5e6e-48e0-a7e5-d51ea5d2fda5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:02.630353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:02.650639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30116-e74e-445e-b1cc-1874fe488f36 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.687594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:02.688447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.688737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.689017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.697628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:02.699236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:02.706814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:02.713362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60e014-5e6e-48e0-a7e5-d51ea5d2fda5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:00:02.716457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:02.717412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:00:02.718384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:02.722316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 485/976] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 08:00:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:02.723641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:02.756622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:02.757540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.758080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.758654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.759367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:02.760828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:02.762257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING keystone.server.flask.common [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 08:00:02.823459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.sql.core [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:00:02.823459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 08:00:02.823459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [parameters: {'user_id': '43795ee7b47a48c9836a8ac5cf8ab53e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 08:00:02.823459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 08:00:02.827846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7dc9-3f80-4d62-b712-b8727bbee558 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b717d4b3-56c3-4154-af9c-c7062d5d536e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jun 24 08:00:02.830861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:00:02.831804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application yield resource Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise self.value Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application session.commit() Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 08:00:02.832850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.flush() Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application compat.raise_( Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 08:00:02.833756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:00:02.834660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:00:02.837176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [parameters: {'user_id': '43795ee7b47a48c9836a8ac5cf8ab53e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:02.838968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 08:00:02.840666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 492/977] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 08:00:02 2022] POST /identity/v3/users => generated 160 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca611-5ae9-4e05-ad38-8170df4df73b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca611-5ae9-4e05-ad38-8170df4df73b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.842574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ca611-5ae9-4e05-ad38-8170df4df73b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.849374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 493/978] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:02.849374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ca611-5ae9-4e05-ad38-8170df4df73b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:02.875995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5285a3-fc1c-408d-9536-9c01540372a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:02.876721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5285a3-fc1c-408d-9536-9c01540372a4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.877007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5285a3-fc1c-408d-9536-9c01540372a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.877297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5285a3-fc1c-408d-9536-9c01540372a4 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.878798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5285a3-fc1c-408d-9536-9c01540372a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:02.879112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5285a3-fc1c-408d-9536-9c01540372a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:02.880619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5285a3-fc1c-408d-9536-9c01540372a4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:02.895216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:02.899634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 486/979] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 08:00:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:02.901101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263f47-172f-4411-b705-49d016f9e015 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:02.901465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263f47-172f-4411-b705-49d016f9e015 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:02.901815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263f47-172f-4411-b705-49d016f9e015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:02.918329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-30263f47-172f-4411-b705-49d016f9e015 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:02.919538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30263f47-172f-4411-b705-49d016f9e015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:02.963494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ca611-5ae9-4e05-ad38-8170df4df73b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:02.997003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 487/980] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:02.997990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263f47-172f-4411-b705-49d016f9e015 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:03.016400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:03.018162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:03.018638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:03.019136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:03.028542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:03.030094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:00:03.044495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:03.045674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:00:03.047069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:03.051146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 494/981] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:03.052028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:03.071047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:03.113450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263f47-172f-4411-b705-49d016f9e015 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:03.148932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:03.153101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edb8e-414a-4588-9687-206544acb394 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:03.157387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:03.158283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:03.159232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:03.160167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:03.193324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:03.194202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:03.194777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:03.195934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:03.196844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:03.198385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:03.229933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:03.231308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:03.321040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 495/982] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 08:00:03 2022] POST /identity/v3/services => generated 242 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:03.322242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:03.340112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 488/983] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:03.346652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:03.383231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:03.454081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:03.469641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b182d1-69ee-46bb-ac3e-bdccdc019ceb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:03.493497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938efcda-74db-4386-83c0-c72d86bbea17 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:03.514393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:03.515780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:03.516262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:03.516745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:03.532575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:03.535249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:03.538116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:03.539124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:03.539409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:03.539685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:03.540541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:03.540846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:03.542267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:03.554096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:03.555019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:03.555931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:03.555931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:03.555931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:03.555931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:03.555931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 489/984] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:03.562365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:03.587177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 496/985] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 08:00:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:03.678677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:03.701086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81307-c158-48db-97da-394f7c0577c6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:03.741209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:03.742249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:03.742740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:03.743196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:03.744165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:03.744691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:03.746246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:03.759313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 490/986] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:03.764679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:03.882894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94f7c-c924-41ed-aede-139e76b9d967 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:03.914289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:03.919101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:03.919888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:03.920165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:03.920464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:03.927611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:03.931783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:00:03.943831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:03.944997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:03.945923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 497/987] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:03.950999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:04.057307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499fe4-84c9-4bd1-aa7b-f37a23e0cb15 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:04.091013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885f323-128d-4ea6-a0f9-202bac3e4ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:04.091669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f323-128d-4ea6-a0f9-202bac3e4ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:04.091951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f323-128d-4ea6-a0f9-202bac3e4ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:04.092252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f323-128d-4ea6-a0f9-202bac3e4ea2 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:04.093033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885f323-128d-4ea6-a0f9-202bac3e4ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:04.093344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885f323-128d-4ea6-a0f9-202bac3e4ea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:04.094771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885f323-128d-4ea6-a0f9-202bac3e4ea2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:04.111646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 491/988] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:04.113010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:04.214012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa4147-7f92-435b-9da3-d95d65dc6fc2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:04.247271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6b8b-f7e0-4e3e-b930-8b04918a02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:04.247916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6b8b-f7e0-4e3e-b930-8b04918a02e5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:04.248234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6b8b-f7e0-4e3e-b930-8b04918a02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:04.248498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6b8b-f7e0-4e3e-b930-8b04918a02e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:04.249319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6b8b-f7e0-4e3e-b930-8b04918a02e5 None admin] RBAC: Adding query filter params (role.id=32e446f6c32f4fb9a9cbedd10ef67bdf, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=650f8582a9ce4fc29f1a31e01dd74cbb) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:04.249628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6b8b-f7e0-4e3e-b930-8b04918a02e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:04.251045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6b8b-f7e0-4e3e-b930-8b04918a02e5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:04.257774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 498/989] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:04 2022] GET /identity/v3/role_assignments?user.id=650f8582a9ce4fc29f1a31e01dd74cbb&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=32e446f6c32f4fb9a9cbedd10ef67bdf => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:04.262074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469ca2-4e2e-4026-a5d0-e0184a8ed3b5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:04.270089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469ca2-4e2e-4026-a5d0-e0184a8ed3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:04.270089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469ca2-4e2e-4026-a5d0-e0184a8ed3b5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:04.270089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 492/990] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:04.270623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467143e-ab4f-4331-8035-a1933c0b39b6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:04.270934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467143e-ab4f-4331-8035-a1933c0b39b6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:04.271219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467143e-ab4f-4331-8035-a1933c0b39b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:04.290048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c467143e-ab4f-4331-8035-a1933c0b39b6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:04.291680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c467143e-ab4f-4331-8035-a1933c0b39b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:04.349323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:04.367416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 499/991] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:04.391962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469ca2-4e2e-4026-a5d0-e0184a8ed3b5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:04.394997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:04.498244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469ca2-4e2e-4026-a5d0-e0184a8ed3b5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:04.534485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:04.535450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:04.535734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:04.536011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:04.536703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:04.538081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:04.551060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:04.552156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:04.553092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 493/992] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 08:00:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:04.560238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467143e-ab4f-4331-8035-a1933c0b39b6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:04.665116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467143e-ab4f-4331-8035-a1933c0b39b6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:04.699734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:04.700483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:04.700765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:04.701036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:04.701731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:04.702029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:04.703376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:04.713166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 500/993] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 08:00:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:04.714471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:04.784111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:04.818823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf0f81-bb00-41a6-9823-068e0a82be4b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:04.852929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05251c-f18b-4ba3-923a-ac135f26ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:04.853587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05251c-f18b-4ba3-923a-ac135f26ac85 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:04.853870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05251c-f18b-4ba3-923a-ac135f26ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:04.854145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05251c-f18b-4ba3-923a-ac135f26ac85 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:04.854848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05251c-f18b-4ba3-923a-ac135f26ac85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:04.855155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05251c-f18b-4ba3-923a-ac135f26ac85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:04.856543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05251c-f18b-4ba3-923a-ac135f26ac85 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:04.861497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 494/994] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 08:00:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:04.867242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:04.918934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:04.969026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f5277-b0ab-4f9e-9ad2-a46144becdbc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:05.003913 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25f40-0e7d-4070-9544-ddb85d156348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:05.004604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25f40-0e7d-4070-9544-ddb85d156348 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:05.004884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25f40-0e7d-4070-9544-ddb85d156348 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:05.005156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25f40-0e7d-4070-9544-ddb85d156348 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:05.005905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25f40-0e7d-4070-9544-ddb85d156348 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:05.007286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25f40-0e7d-4070-9544-ddb85d156348 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:05.098047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 501/995] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 08:00:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:05.494954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d25cce-1240-42de-93c3-ff0a29be79a1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:05.495248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d25cce-1240-42de-93c3-ff0a29be79a1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:05.495535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d25cce-1240-42de-93c3-ff0a29be79a1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:05.496955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 495/996] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:05.502164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779f57-6813-42ca-a506-785d1959c078 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:05.502751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779f57-6813-42ca-a506-785d1959c078 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:05.502919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779f57-6813-42ca-a506-785d1959c078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:05.519557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-df779f57-6813-42ca-a506-785d1959c078 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:05.520769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-df779f57-6813-42ca-a506-785d1959c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:05.604508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 502/997] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:05.626680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d25cce-1240-42de-93c3-ff0a29be79a1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:05.731412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d25cce-1240-42de-93c3-ff0a29be79a1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:05.759913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:05.766097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:05.766893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:05.770926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:05.770926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:05.770926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:05.770926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:05.782033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:05.783228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:05.784958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:05.788473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 496/998] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:00:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:05.789836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779f57-6813-42ca-a506-785d1959c078 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:05.826499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:05.892024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779f57-6813-42ca-a506-785d1959c078 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:05.928470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:05.929130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:05.929413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:05.929686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:05.930381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:05.930679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:05.932026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:05.941735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 503/999] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 08:00:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:05.943017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:06.045910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1df75-0e6c-463d-a786-6c833aebf69d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:06.079812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:06.081320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.081813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.082310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.083235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:06.083745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:06.085336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:06.090862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 497/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 08:00:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:06.096896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:06.199913 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:06.203069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbaf08-56b3-4bcf-8dee-90a9c15e1721 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:06.238801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb266e-be75-4f24-9377-ffeca076d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:06.239470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb266e-be75-4f24-9377-ffeca076d55f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.239813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb266e-be75-4f24-9377-ffeca076d55f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.240077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb266e-be75-4f24-9377-ffeca076d55f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.241358 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb266e-be75-4f24-9377-ffeca076d55f None admin] RBAC: Adding query filter params (interface=public, service_id=321c16acc7254803b3db10445af59f93, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:06.242035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb266e-be75-4f24-9377-ffeca076d55f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:06.243945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb266e-be75-4f24-9377-ffeca076d55f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:06.254636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 504/1001] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 08:00:06 2022] GET /identity/v3/endpoints?service_id=321c16acc7254803b3db10445af59f93&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:06.256262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:06.318051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:06.349449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37fe0b-6df6-452a-af2d-fa314142eeb7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.349766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37fe0b-6df6-452a-af2d-fa314142eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.350010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37fe0b-6df6-452a-af2d-fa314142eeb7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.351755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 505/1002] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:06.357218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdbb5d-b0e0-4338-987d-ca8689a0f443 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.357505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdbb5d-b0e0-4338-987d-ca8689a0f443 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.357789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdbb5d-b0e0-4338-987d-ca8689a0f443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.360848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0124e8-96df-434e-b631-d110b79774bc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:06.377017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ccfdbb5d-b0e0-4338-987d-ca8689a0f443 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:06.379832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ccfdbb5d-b0e0-4338-987d-ca8689a0f443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:06.399492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:06.400158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.400472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.400773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.401469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:06.402817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:06.409436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 498/1003] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 08:00:06 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:00:06.453741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 506/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:06.478098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:06.592869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc295f-3870-4ebe-95ed-d08aef434113 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:06.616821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:06.628847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:06.629686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.630388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.630388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.630983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:06.632368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:06.643976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:06.645173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:06.646033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 499/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 08:00:06 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:06.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdbb5d-b0e0-4338-987d-ca8689a0f443 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:06.746505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:06.754430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdbb5d-b0e0-4338-987d-ca8689a0f443 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:06.791657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244d4cf-e5ec-4727-bcd0-bbf32633a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:06.792347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d4cf-e5ec-4727-bcd0-bbf32633a08a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.792629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d4cf-e5ec-4727-bcd0-bbf32633a08a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.792900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d4cf-e5ec-4727-bcd0-bbf32633a08a None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.793608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244d4cf-e5ec-4727-bcd0-bbf32633a08a None admin] RBAC: Adding query filter params (name=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:06.793913 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244d4cf-e5ec-4727-bcd0-bbf32633a08a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:06.795270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244d4cf-e5ec-4727-bcd0-bbf32633a08a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:06.800743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 507/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:06.806152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:06.910239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd0160-6bcf-49fd-8f9e-ddee3e75e2d3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:06.944737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644529d-79c8-46b3-a370-b593f9deac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:06.945418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644529d-79c8-46b3-a370-b593f9deac0d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:06.945703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644529d-79c8-46b3-a370-b593f9deac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:06.945980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644529d-79c8-46b3-a370-b593f9deac0d None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:06.946684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644529d-79c8-46b3-a370-b593f9deac0d None admin] RBAC: Adding query filter params (type=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:06.946989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644529d-79c8-46b3-a370-b593f9deac0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:06.948382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644529d-79c8-46b3-a370-b593f9deac0d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:06.956460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 500/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:07.172946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f1ce6-670b-48a8-a99f-0a0246f39d2c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:07.173145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f1ce6-670b-48a8-a99f-0a0246f39d2c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:07.173414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f1ce6-670b-48a8-a99f-0a0246f39d2c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:07.175631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 508/1008] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:07.181066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bafc4-c813-4f8e-abfa-f7cef5d2fbd5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:07.181450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bafc4-c813-4f8e-abfa-f7cef5d2fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:07.181797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bafc4-c813-4f8e-abfa-f7cef5d2fbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:07.198918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5e3bafc4-c813-4f8e-abfa-f7cef5d2fbd5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:07.200082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5e3bafc4-c813-4f8e-abfa-f7cef5d2fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:07.247878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:07.270144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 501/1009] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:07.294474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f1ce6-670b-48a8-a99f-0a0246f39d2c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:07.401033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f1ce6-670b-48a8-a99f-0a0246f39d2c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:07.435896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699a192-9167-424e-8f76-43feaf856233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:07.436630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a192-9167-424e-8f76-43feaf856233 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:07.436909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a192-9167-424e-8f76-43feaf856233 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:07.437180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a192-9167-424e-8f76-43feaf856233 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:07.438332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699a192-9167-424e-8f76-43feaf856233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:07.439769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699a192-9167-424e-8f76-43feaf856233 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:07.442182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 509/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:07.447751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bafc4-c813-4f8e-abfa-f7cef5d2fbd5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:07.552424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bafc4-c813-4f8e-abfa-f7cef5d2fbd5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:07.598178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c4fd6-d7ab-44e5-8119-b306fba347c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:07.599170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4fd6-d7ab-44e5-8119-b306fba347c5 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:07.599670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4fd6-d7ab-44e5-8119-b306fba347c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:07.600159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4fd6-d7ab-44e5-8119-b306fba347c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:07.601095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c4fd6-d7ab-44e5-8119-b306fba347c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:07.602708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c4fd6-d7ab-44e5-8119-b306fba347c5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:07.699795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 502/1011] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 08:00:07 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:08.498406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8a46-2040-43fc-afed-7987be8ba925 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:08.498960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8a46-2040-43fc-afed-7987be8ba925 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:08.498960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8a46-2040-43fc-afed-7987be8ba925 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:08.500502 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 510/1012] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:08.506056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b553-0921-44ed-a46a-7a11c0835a57 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:08.506351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b553-0921-44ed-a46a-7a11c0835a57 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:08.506630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b553-0921-44ed-a46a-7a11c0835a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:08.524366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-aee2b553-0921-44ed-a46a-7a11c0835a57 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:08.525567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aee2b553-0921-44ed-a46a-7a11c0835a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:08.552067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:08.597540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 503/1013] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:08.620070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8a46-2040-43fc-afed-7987be8ba925 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:08.650147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:08.726949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8a46-2040-43fc-afed-7987be8ba925 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:08.761722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:08.762518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:08.762803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:08.763081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:08.763733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:08.765117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:08.777203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:08.778213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:00:08.779072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:08.786321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 511/1014] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:00:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:08.786459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b553-0921-44ed-a46a-7a11c0835a57 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:08.894823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b553-0921-44ed-a46a-7a11c0835a57 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:08.930989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0f434-f9cb-4d6c-ba85-7a77fde74204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:08.931770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f434-f9cb-4d6c-ba85-7a77fde74204 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:08.932064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f434-f9cb-4d6c-ba85-7a77fde74204 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:08.932375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f434-f9cb-4d6c-ba85-7a77fde74204 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:08.933082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f434-f9cb-4d6c-ba85-7a77fde74204 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:08.933389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f434-f9cb-4d6c-ba85-7a77fde74204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:08.934748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f434-f9cb-4d6c-ba85-7a77fde74204 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:08.944785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 504/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 08:00:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:08.946332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:08.986690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecb4f4-4e7e-4789-b0cd-96e46eecbd47 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:08.987561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecb4f4-4e7e-4789-b0cd-96e46eecbd47 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:08.987773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecb4f4-4e7e-4789-b0cd-96e46eecbd47 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:08.989306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 505/1016] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:08.993894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd2371-aab0-4842-a2e1-dd65ef7518b2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:08.994183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd2371-aab0-4842-a2e1-dd65ef7518b2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:08.994558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd2371-aab0-4842-a2e1-dd65ef7518b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:09.012294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c2dd2371-aab0-4842-a2e1-dd65ef7518b2 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:09.013397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c2dd2371-aab0-4842-a2e1-dd65ef7518b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:09.035916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:09.043165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:09.053145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d486-5d39-486d-ba21-9bec8d9ccd23 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:09.087748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:09.088096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 506/1017] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:09.088446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:09.088726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:09.088998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:09.089699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:09.089998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:09.091348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:09.104237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 512/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 08:00:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:09.105734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd2371-aab0-4842-a2e1-dd65ef7518b2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:09.110540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:09.214755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd2371-aab0-4842-a2e1-dd65ef7518b2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:09.215800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288edfe-0fff-4169-b034-346038f79686 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:09.251066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a20e4-1e7c-45be-a13e-91c5c1d82cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:09.251727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a20e4-1e7c-45be-a13e-91c5c1d82cf8 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:09.252010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a20e4-1e7c-45be-a13e-91c5c1d82cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:09.252309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a20e4-1e7c-45be-a13e-91c5c1d82cf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:09.253095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a20e4-1e7c-45be-a13e-91c5c1d82cf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:09.254222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcd1b3-4d0f-400b-b704-93c98ea113b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:09.254491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a20e4-1e7c-45be-a13e-91c5c1d82cf8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:09.255219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd1b3-4d0f-400b-b704-93c98ea113b5 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:09.255642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd1b3-4d0f-400b-b704-93c98ea113b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:09.256057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd1b3-4d0f-400b-b704-93c98ea113b5 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:09.256943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcd1b3-4d0f-400b-b704-93c98ea113b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:09.258485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcd1b3-4d0f-400b-b704-93c98ea113b5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:09.344421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 513/1019] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 08:00:09 2022] POST /identity/v3/services => generated 242 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:00:09.379912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 507/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 08:00:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:00:09.800123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf68ee8-8d9b-4388-899a-137fcff61bcb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:09.800699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf68ee8-8d9b-4388-899a-137fcff61bcb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:09.800699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf68ee8-8d9b-4388-899a-137fcff61bcb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:09.802251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 514/1021] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:09.807419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0c643-1559-4a01-81dc-b2ecfdd129c9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:09.807834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0c643-1559-4a01-81dc-b2ecfdd129c9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:09.808037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0c643-1559-4a01-81dc-b2ecfdd129c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:09.824805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-26b0c643-1559-4a01-81dc-b2ecfdd129c9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:09.826001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-26b0c643-1559-4a01-81dc-b2ecfdd129c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:09.834999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:09.904224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 508/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:09.928992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf68ee8-8d9b-4388-899a-137fcff61bcb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:09.946009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:10.036566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf68ee8-8d9b-4388-899a-137fcff61bcb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:10.070830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d32749-4671-4f3a-b1b4-a617b5a6e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:10.071546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d32749-4671-4f3a-b1b4-a617b5a6e060 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:10.071827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d32749-4671-4f3a-b1b4-a617b5a6e060 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:10.072134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d32749-4671-4f3a-b1b4-a617b5a6e060 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:10.073319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d32749-4671-4f3a-b1b4-a617b5a6e060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:10.074787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d32749-4671-4f3a-b1b4-a617b5a6e060 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:10.076632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 515/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:10.082776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0c643-1559-4a01-81dc-b2ecfdd129c9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:10.183000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0c643-1559-4a01-81dc-b2ecfdd129c9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:10.218323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07308ff0-1d4d-4d68-9920-acaed8a7bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:10.219008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308ff0-1d4d-4d68-9920-acaed8a7bdb7 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:10.219295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308ff0-1d4d-4d68-9920-acaed8a7bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:10.219573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308ff0-1d4d-4d68-9920-acaed8a7bdb7 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:10.220319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07308ff0-1d4d-4d68-9920-acaed8a7bdb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:10.221796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07308ff0-1d4d-4d68-9920-acaed8a7bdb7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:10.231017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:10.372307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 509/1024] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 08:00:10 2022] POST /identity/v3/users => generated 285 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:00:11.428998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93dd2-bc6f-40c7-9b04-822f4bb349f6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.429520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93dd2-bc6f-40c7-9b04-822f4bb349f6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.429637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93dd2-bc6f-40c7-9b04-822f4bb349f6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.431072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 516/1025] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:11.436175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dae4a-1c7b-4643-a770-6870416a1e79 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.436583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dae4a-1c7b-4643-a770-6870416a1e79 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.436749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dae4a-1c7b-4643-a770-6870416a1e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.453391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dd8dae4a-1c7b-4643-a770-6870416a1e79 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:11.454567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dd8dae4a-1c7b-4643-a770-6870416a1e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:11.523043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 510/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:11.543359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7764ec-7f1e-4fa8-9331-5a0c92ec8d2c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.543679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7764ec-7f1e-4fa8-9331-5a0c92ec8d2c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.543912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7764ec-7f1e-4fa8-9331-5a0c92ec8d2c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.545436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 517/1027] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:11.546887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dae4a-1c7b-4643-a770-6870416a1e79 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:11.550551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6202cb7-575e-4204-af40-44f7000c8d44 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.551015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6202cb7-575e-4204-af40-44f7000c8d44 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.551293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6202cb7-575e-4204-af40-44f7000c8d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.567708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b6202cb7-575e-4204-af40-44f7000c8d44 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:11.568934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6202cb7-575e-4204-af40-44f7000c8d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:11.642714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 518/1028] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:11.666486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dae4a-1c7b-4643-a770-6870416a1e79 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:11.666681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6202cb7-575e-4204-af40-44f7000c8d44 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:11.682934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:11.694600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:11.705263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:11.706261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.706694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.707150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.707977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:11.709520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:11.721663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:11.723044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:11.724066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 511/1029] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 08:00:11 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:11.728839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:11.779449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6202cb7-575e-4204-af40-44f7000c8d44 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:11.816852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:11.817663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.817943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.818216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.828236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:11.836017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227729-50e0-49b6-adce-fe544062cdf8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:11.836810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:11.837712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:11.838566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 519/1030] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 08:00:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:11.843815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:11.876129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:11.876810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.877083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.877629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.878300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] RBAC: Adding query filter params (name=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:11.878630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:11.880136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:11.885720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 512/1031] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:11.891047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:11.919403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:11.950096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34067c50-62e0-4ec0-9e50-6e6b1ae4e9df None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:11.951899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:11.987641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:11.988527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:11.988820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:11.989097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:11.989852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:11.990505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:11.991516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.000444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 520/1032] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 08:00:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:12.003829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44722d-b5d6-4040-bd62-d4ed17b9000b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.006060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.041354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.042110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.042491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.042777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.043486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] RBAC: Adding query filter params (type=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:12.043782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.045237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.050777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 513/1033] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:12.056264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.108742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae566-293d-4270-9c52-98a7fc13a26e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.144883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.145678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.145957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.146239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.148646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:12.158026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.159475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.172773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bd26-69db-4bf7-9ea6-514df9437999 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:12.176753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:12.177648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:12.178543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:12.178543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:12.178543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:12.178543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:12.182814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 521/1034] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:12.183534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.192046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:12.210499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.211190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.211544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.211828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.212648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] RBAC: Adding query filter params (interface=public, service_id=16d8e1ec06dc46848dd6da813f7bd13a, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:12.212961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.214325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.219735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 514/1035] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/endpoints?service_id=16d8e1ec06dc46848dd6da813f7bd13a&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:12.225109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.300557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f39aa-9ecb-4664-9492-763163167b9c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.336072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.336805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.337088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.337364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.338088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:12.338394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.339755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.345642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f6bd-b884-4978-9583-d4c9c0eeb53b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.356928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 522/1036] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:12.358050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.385369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dabc82-5d0f-4438-a88f-3d9988f127a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.386032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dabc82-5d0f-4438-a88f-3d9988f127a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.386316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dabc82-5d0f-4438-a88f-3d9988f127a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.386587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dabc82-5d0f-4438-a88f-3d9988f127a0 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.387259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dabc82-5d0f-4438-a88f-3d9988f127a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.388659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dabc82-5d0f-4438-a88f-3d9988f127a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.396942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 515/1037] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:00:12.411002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:12.470319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ce1b-5959-4b9b-afe7-2e5ddd0362cc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.497165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcef14-4ca8-4c38-ba60-510a9f70063b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.497694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcef14-4ca8-4c38-ba60-510a9f70063b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.497694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcef14-4ca8-4c38-ba60-510a9f70063b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.499084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 516/1038] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:12.505781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55839-b5ab-4296-8c4c-3d51dac6f2dd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.506071 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55839-b5ab-4296-8c4c-3d51dac6f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.506334 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55839-b5ab-4296-8c4c-3d51dac6f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.511383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.512209 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.512505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.512783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.521061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.522506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.525530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-82e55839-b5ab-4296-8c4c-3d51dac6f2dd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:12.526834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-82e55839-b5ab-4296-8c4c-3d51dac6f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:00:12.539170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:12.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:12.541476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 523/1039] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:12.546490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.580701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:12.610716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 517/1040] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:12.635826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55839-b5ab-4296-8c4c-3d51dac6f2dd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.662963 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4d24-323e-45f1-b7a7-50a6630718b5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.670933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:12.701347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.702012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.702291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.702568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.703398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:12.703700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.705155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.727526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 524/1041] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:12.732988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.746165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55839-b5ab-4296-8c4c-3d51dac6f2dd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.785382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.786292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.786575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.786849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.797371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:12.806469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:12.807466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:12.809118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 518/1042] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:12.813444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:12.836656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e789f9-6e06-4772-a5eb-bae4c4d7d60f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.851792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:12.874019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.874700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.874952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.875231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.909898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:12.926115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72446-9178-4b74-bfab-3f2692b43176 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:12.950863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.952465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.964349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:12.965548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:12.966020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:12.966638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:12.967956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:12.968651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:12.970048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:12.979090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 519/1043] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:12.984443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.059179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 525/1044] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:13.064791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.091753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.098934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e671396-4244-4f85-bc32-cbfeb6471b19 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.128264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.136037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.136882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.137162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.137423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] PATH_INFO: `/v3/users/9f1a73a9f4b74e39923ba7e003664dca` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.152781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] RBAC: Authorizing `identity:get_user(user_id=9f1a73a9f4b74e39923ba7e003664dca)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.154227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.156119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 520/1045] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:12 2022] GET /identity/v3/users/9f1a73a9f4b74e39923ba7e003664dca => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:13.161582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.176082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f2f9-49d6-427f-9d5b-586739d4961a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.212069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.212878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.213158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.213430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.223609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.225063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:13.244170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:13.245123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:13.246038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:13.246038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:13.246038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:13.246038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:13.246038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 526/1046] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:13.250824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.266730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724556-a4ec-4158-b7a0-879bc33f2665 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.303751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.304495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.304701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.305007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.330218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.363897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f7ea-69fd-42bd-b134-3d3cecc1b462 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.375795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.378250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.383289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.403507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.404162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.404485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.404777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.405498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:13.405793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.407139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.423039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 527/1047] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:13.423907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.495972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 521/1048] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:00:13.501528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.540474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7129-899f-4cb1-abf2-513091a10aef None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.564106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.581589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.582785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.582875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.583894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.590523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.591978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:00:13.606204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:13.607195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:13.608102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 528/1049] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:13.613886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.619994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da252c-5560-4544-a25b-42a86206f63b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.653287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.657669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.658530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.659320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.659594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.660857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e725529e345f4a54487ac507b6dc2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.662281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.664042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 522/1050] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:13.669875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.733531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d0c27-961f-4c66-8448-052a38c23cbe None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.771700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.772397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.772684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.773113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.774106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:13.774424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.775846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.776098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da9b3b-367a-423a-a05a-4034670759e3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.788381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 529/1051] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:13.794157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:13.801642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.812776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf4869-40f9-4262-b1f9-61c17a000a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.813580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf4869-40f9-4262-b1f9-61c17a000a5f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.813686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf4869-40f9-4262-b1f9-61c17a000a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.813938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf4869-40f9-4262-b1f9-61c17a000a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.814759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf4869-40f9-4262-b1f9-61c17a000a5f None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=b07e725529e345f4a54487ac507b6dc2, user.id=9f1a73a9f4b74e39923ba7e003664dca) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:13.815164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf4869-40f9-4262-b1f9-61c17a000a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.816673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf4869-40f9-4262-b1f9-61c17a000a5f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.822153 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 523/1052] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/role_assignments?user.id=9f1a73a9f4b74e39923ba7e003664dca&scope.project.id=b07e725529e345f4a54487ac507b6dc2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:13.903265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:13.910589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91e73-70c0-462c-84a6-bf5c41ef8d52 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:13.946683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79ec67-df72-43fb-99df-df861458ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:13.947352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79ec67-df72-43fb-99df-df861458ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:13.947632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79ec67-df72-43fb-99df-df861458ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:13.947906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79ec67-df72-43fb-99df-df861458ec09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:13.948775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79ec67-df72-43fb-99df-df861458ec09 None admin] RBAC: Adding query filter params (role.id=32e446f6c32f4fb9a9cbedd10ef67bdf, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7602c632829d44179aa129c552d1870a) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:13.949087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79ec67-df72-43fb-99df-df861458ec09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:13.950529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79ec67-df72-43fb-99df-df861458ec09 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:13.964257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 530/1053] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:13 2022] GET /identity/v3/role_assignments?user.id=7602c632829d44179aa129c552d1870a&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=32e446f6c32f4fb9a9cbedd10ef67bdf => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:14.461885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170df55-891d-4eb6-9a86-7da4404b8bfd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:14.462271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170df55-891d-4eb6-9a86-7da4404b8bfd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:14.462452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170df55-891d-4eb6-9a86-7da4404b8bfd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:14.463875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 524/1054] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:14.469201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f9ab0-540f-4f6d-a02c-ff399e30ff7f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:14.469493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f9ab0-540f-4f6d-a02c-ff399e30ff7f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:14.469772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f9ab0-540f-4f6d-a02c-ff399e30ff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:14.486478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fa9f9ab0-540f-4f6d-a02c-ff399e30ff7f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:14.487696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fa9f9ab0-540f-4f6d-a02c-ff399e30ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:14.555388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 531/1055] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:14.580219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170df55-891d-4eb6-9a86-7da4404b8bfd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:14.684012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170df55-891d-4eb6-9a86-7da4404b8bfd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:14.717421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:14.718115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:14.718395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:14.718669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] PATH_INFO: `/v3/services/image` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:14.719311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:14.720697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:14.733006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:14.733977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:14.740903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 525/1056] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 08:00:14 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:14.743340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f9ab0-540f-4f6d-a02c-ff399e30ff7f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:14.837028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:14.849209 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f9ab0-540f-4f6d-a02c-ff399e30ff7f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:14.883456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:14.884118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:14.884428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:14.884759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:14.885464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] RBAC: Adding query filter params (name=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:14.885812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:14.887165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:14.896270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 532/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:14.899275 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:14.952690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:15.004757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7934a-6789-4c74-bc4d-196fd6200333 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:15.039755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4bed2-f7a8-4999-b488-4629201bd5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:15.040480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4bed2-f7a8-4999-b488-4629201bd5eb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:15.040767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4bed2-f7a8-4999-b488-4629201bd5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:15.041048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4bed2-f7a8-4999-b488-4629201bd5eb None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:15.041775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4bed2-f7a8-4999-b488-4629201bd5eb None admin] RBAC: Adding query filter params (type=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:15.042085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4bed2-f7a8-4999-b488-4629201bd5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:15.043467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4bed2-f7a8-4999-b488-4629201bd5eb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:15.053667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 526/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:15.055211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:15.156608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2795a-c452-404b-a57f-d5cbb1b930fa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:15.190831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eeb4f-0558-4f93-a4ca-f1333bd302e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:15.191531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eeb4f-0558-4f93-a4ca-f1333bd302e0 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:15.191819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eeb4f-0558-4f93-a4ca-f1333bd302e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:15.192097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eeb4f-0558-4f93-a4ca-f1333bd302e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:15.192870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eeb4f-0558-4f93-a4ca-f1333bd302e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:15.194232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eeb4f-0558-4f93-a4ca-f1333bd302e0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:15.276646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 533/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 08:00:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:15.869858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf9dc9-02a4-4572-8139-42888a166c25 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:15.870347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf9dc9-02a4-4572-8139-42888a166c25 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:15.870347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf9dc9-02a4-4572-8139-42888a166c25 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:15.871885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 527/1060] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:15.876977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952584b7-b0b0-49e9-872d-bcaaf8f4d725 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:15.877395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952584b7-b0b0-49e9-872d-bcaaf8f4d725 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:15.878236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952584b7-b0b0-49e9-872d-bcaaf8f4d725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:15.895199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-952584b7-b0b0-49e9-872d-bcaaf8f4d725 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:15.896414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-952584b7-b0b0-49e9-872d-bcaaf8f4d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:15.900323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:15.957300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e6a1-e899-47bc-986e-c2df21801704 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:15.957569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e6a1-e899-47bc-986e-c2df21801704 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:15.957842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e6a1-e899-47bc-986e-c2df21801704 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:15.959476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 528/1061] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:15.964213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c0ac-3e0b-4f5f-8e77-d1c64674f29e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:15.964528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c0ac-3e0b-4f5f-8e77-d1c64674f29e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:15.964821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c0ac-3e0b-4f5f-8e77-d1c64674f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:15.976228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 534/1062] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:15.985207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ffb9c0ac-3e0b-4f5f-8e77-d1c64674f29e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:15.986398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ffb9c0ac-3e0b-4f5f-8e77-d1c64674f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:15.999423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952584b7-b0b0-49e9-872d-bcaaf8f4d725 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.063721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 529/1063] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:16.087213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c0ac-3e0b-4f5f-8e77-d1c64674f29e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.106914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952584b7-b0b0-49e9-872d-bcaaf8f4d725 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.143134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.143320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:16.144412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.144669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.144941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.147897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:16.156090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:16.164528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:16.165453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:16.166319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 535/1064] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:16.172064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.207176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c0ac-3e0b-4f5f-8e77-d1c64674f29e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.242413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.243492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.243767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.244036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.255395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:16.263565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:16.269030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:16.269949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 530/1065] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:16.271372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.286703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3454f8-4b66-42e8-b1a9-9b2fe53a721a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.321887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.322691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.323010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.323259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.324000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:16.324348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.325729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.335459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 536/1066] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:16.340797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.387105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3829ed-e52b-4332-ad7e-88cdf11b481d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.390602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:16.406837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:16.435952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.436701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.439279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.439279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.439279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:16.439279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.441131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.450432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 531/1067] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:16.451110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd27638-157e-4810-ae2c-6c3196c9320c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.456735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.489128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.490332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.490607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.490873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] PATH_INFO: `/v3/users/9f1a73a9f4b74e39923ba7e003664dca` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.492318 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=9f1a73a9f4b74e39923ba7e003664dca)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.493506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.499966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 537/1068] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/users/9f1a73a9f4b74e39923ba7e003664dca => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:16.500651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.573575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299600-eccb-4de0-9752-78aaf5577a2e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.612085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.612912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.613187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.613458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.617703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ca3b-2056-451d-aba2-6cc649e3c1a9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.624164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.626026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.644441 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:16.645371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:16.651330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:16.652562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:16.652562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:16.652562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:16.652562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:16.652562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 532/1069] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:16.654096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.661482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.662342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.662623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.662898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.664102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] RBAC: Authorizing `identity:get_project(project_id=b07e725529e345f4a54487ac507b6dc2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.665580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.668218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 538/1070] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:16.673425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.679023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:16.761968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484acac-f36d-4ed0-9a39-2c92a3ae563f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.786070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4745-1ee9-44a7-8717-a8c2ad82f6fd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.797980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.798566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.798884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.799188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.799962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:16.800319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.801735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.814157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 533/1071] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:16.820126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:16.823520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.824464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.824774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.825057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2/users/9f1a73a9f4b74e39923ba7e003664dca/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.827041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e725529e345f4a54487ac507b6dc2, user_id=9f1a73a9f4b74e39923ba7e003664dca, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.828515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.901191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:16.921935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78842c6-ac69-40d7-b4a0-d29ec1f2bca3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:16.938684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 539/1072] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 08:00:16 2022] PUT /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2/users/9f1a73a9f4b74e39923ba7e003664dca/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:00:16.969487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:16.970298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:16.970576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:16.970843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:16.980714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:16.982174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:00:16.998536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:16.999607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:17.005301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 534/1073] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 08:00:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:17.008594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.073699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:17.123131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645879-b8a9-4b55-8919-99444c8b8c62 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:17.158065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74e753-0469-4427-9863-537c62e1001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:17.158792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e753-0469-4427-9863-537c62e1001b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.159160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e753-0469-4427-9863-537c62e1001b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.159441 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e753-0469-4427-9863-537c62e1001b None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.160305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e753-0469-4427-9863-537c62e1001b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:17.160619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e753-0469-4427-9863-537c62e1001b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:17.162038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e753-0469-4427-9863-537c62e1001b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:17.184407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 540/1074] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:17.185722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.290461 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364adee-189f-4c4f-8f0c-de6edf6c26ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:17.325173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:17.326131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.326458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.326746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.334038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:17.338516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:17.339966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:17.350529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba374226-533d-4d05-8850-f0c2d6d12857 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.350815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba374226-533d-4d05-8850-f0c2d6d12857 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.351092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba374226-533d-4d05-8850-f0c2d6d12857 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.352636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 541/1075] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:17.357252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452052-bbab-4a30-aa24-b49844fb3579 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:17.357526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:17.358384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:17.359302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:17.359302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:17.359302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:17.359302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:17.359526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452052-bbab-4a30-aa24-b49844fb3579 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.359526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452052-bbab-4a30-aa24-b49844fb3579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.359667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 535/1076] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:17.364893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.375782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2a452052-bbab-4a30-aa24-b49844fb3579 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:17.377008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a452052-bbab-4a30-aa24-b49844fb3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:17.449979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 542/1077] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:17.472805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a452052-bbab-4a30-aa24-b49844fb3579 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.473005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ca36-7a14-4204-a7c4-316012057a3f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:17.510285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:17.511029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.511244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.511526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.512277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:17.512594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:17.514000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:17.517569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:17.527175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 536/1078] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:17.532684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.588292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a452052-bbab-4a30-aa24-b49844fb3579 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:17.589120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:17.625782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:17.626440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.626724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.627004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.646128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c3a51-23f8-4c1a-b0b0-5d211528a518 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:17.684273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:17.685583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.686072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.686549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.694068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:17.694559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:17.696019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:17.696131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:00:17.710902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:17.711970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:17.713026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:17.713794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 537/1079] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:17.719244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.744421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:17.803135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 543/1080] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:00:17.809161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.827926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38d6c-c5ae-4a58-9c74-1592b40a768a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:17.838848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:17.863622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:17.864305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.864589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.864863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.865648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:17.865957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:17.867385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:17.880389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 538/1081] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:17.886015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:17.920891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cae1b-399f-4160-81b7-2dbb283a1d3f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:17.956651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:17.957444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:17.957727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:17.958002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:17.968447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:17.969811 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:17.972276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:17.989915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:17.990879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:17.992551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:17.992551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:17.992551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:17.992551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:17.992551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 544/1082] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:17.996896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:18.003338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf497-bf5a-41bf-8902-59787ca5e8be None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:18.042189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acbba0-c464-4e73-9302-6040b52c72d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:18.043102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acbba0-c464-4e73-9302-6040b52c72d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:18.043378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acbba0-c464-4e73-9302-6040b52c72d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:18.043664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acbba0-c464-4e73-9302-6040b52c72d2 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/7602c632829d44179aa129c552d1870a/roles/32e446f6c32f4fb9a9cbedd10ef67bdf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:18.046082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acbba0-c464-4e73-9302-6040b52c72d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=7602c632829d44179aa129c552d1870a, role_id=32e446f6c32f4fb9a9cbedd10ef67bdf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:18.047551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acbba0-c464-4e73-9302-6040b52c72d2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:18.102027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096c8f-fc24-4eb8-a7b7-c453c33764de None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:18.116186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 539/1083] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 08:00:17 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/7602c632829d44179aa129c552d1870a/roles/32e446f6c32f4fb9a9cbedd10ef67bdf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:00:18.141316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd9695-4fc2-4a44-8e4e-03b2381fcf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:18.142011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd9695-4fc2-4a44-8e4e-03b2381fcf8b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:18.142296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd9695-4fc2-4a44-8e4e-03b2381fcf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:18.142577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd9695-4fc2-4a44-8e4e-03b2381fcf8b None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:18.143866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd9695-4fc2-4a44-8e4e-03b2381fcf8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:18.144179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd9695-4fc2-4a44-8e4e-03b2381fcf8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:18.145603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd9695-4fc2-4a44-8e4e-03b2381fcf8b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:18.158888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 545/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:18.990420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2607e1-302e-4f7f-bc07-4ac0928845b8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:18.990813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2607e1-302e-4f7f-bc07-4ac0928845b8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:18.991248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2607e1-302e-4f7f-bc07-4ac0928845b8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:18.992687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 540/1085] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:18.997906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3bb92-0a07-47ea-b944-bbeef24d4652 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:18.998367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3bb92-0a07-47ea-b944-bbeef24d4652 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:18.998459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3bb92-0a07-47ea-b944-bbeef24d4652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:19.015466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-63b3bb92-0a07-47ea-b944-bbeef24d4652 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:19.016665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-63b3bb92-0a07-47ea-b944-bbeef24d4652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:19.064906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:19.083041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 546/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:19.106627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2607e1-302e-4f7f-bc07-4ac0928845b8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:19.137112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:19.208152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2607e1-302e-4f7f-bc07-4ac0928845b8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:19.243873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:19.244619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:19.244902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:19.245175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:19.255955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:19.263499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:19.270062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:19.271191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 541/1087] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:19.272077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3bb92-0a07-47ea-b944-bbeef24d4652 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:19.369038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3bb92-0a07-47ea-b944-bbeef24d4652 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:19.402422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:19.403082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:19.403362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:19.403638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:19.404412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:19.404721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:19.406071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:19.414124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 547/1088] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:19.419680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:19.511249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:19.520614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd7938-6c9f-4b3d-9bc3-272dc688d120 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:19.554264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:19.555125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:19.555405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:19.555679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] PATH_INFO: `/v3/users/9f1a73a9f4b74e39923ba7e003664dca` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:19.556873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] RBAC: Authorizing `identity:get_user(user_id=9f1a73a9f4b74e39923ba7e003664dca)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:19.558282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:19.559906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 542/1089] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:19 2022] GET /identity/v3/users/9f1a73a9f4b74e39923ba7e003664dca => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:19.569072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:19.616676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:19.671372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e754-6480-4320-a2f1-47190363cf38 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:19.704673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:19.705311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:19.705620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:19.705908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:19.772445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:19.774056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:19.818213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:19.871282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 548/1090] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:19.877133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:19.976065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10c33d-5f61-4814-ad15-b78ffb8dfb75 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:20.009334 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6464c50-9be2-405d-84af-408a6af461dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:20.010185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464c50-9be2-405d-84af-408a6af461dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.010468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464c50-9be2-405d-84af-408a6af461dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.010746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464c50-9be2-405d-84af-408a6af461dd None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.011927 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6464c50-9be2-405d-84af-408a6af461dd None admin] RBAC: Authorizing `identity:get_project(project_id=b07e725529e345f4a54487ac507b6dc2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:20.013389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6464c50-9be2-405d-84af-408a6af461dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:20.015085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 543/1091] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:19 2022] GET /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:20.021863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:20.119693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac71ef-70b9-48a2-b07b-ee8dcb933fd4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:20.153511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:20.154159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.154430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5fbd8-cdd8-4c4f-a565-70b963dc42d2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.154877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.154877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.155048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5fbd8-cdd8-4c4f-a565-70b963dc42d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.155048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5fbd8-cdd8-4c4f-a565-70b963dc42d2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.155516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=b07e725529e345f4a54487ac507b6dc2, user.id=9f1a73a9f4b74e39923ba7e003664dca) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:20.155828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:20.156352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 544/1092] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:20.157413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:20.161594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9020-d469-427e-8b7b-74c73ecb024c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.161877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9020-d469-427e-8b7b-74c73ecb024c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.162156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9020-d469-427e-8b7b-74c73ecb024c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.164465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 549/1093] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:20 2022] GET /identity/v3/role_assignments?user.id=9f1a73a9f4b74e39923ba7e003664dca&scope.project.id=b07e725529e345f4a54487ac507b6dc2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:20.179997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-377b9020-d469-427e-8b7b-74c73ecb024c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:20.181258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-377b9020-d469-427e-8b7b-74c73ecb024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:20.203550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:20.272451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 545/1094] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:20.283342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:20.303423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:20.397238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae9ce-e18f-4738-97bf-dcb161012885 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:20.430264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:20.431064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.431346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.431618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.442056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:20.450151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:20.451291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:20.452444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 550/1095] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 08:00:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:20.457844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9020-d469-427e-8b7b-74c73ecb024c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:20.556803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9020-d469-427e-8b7b-74c73ecb024c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:20.593152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:20.593814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.594119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.594389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.595123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:20.595424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:20.597573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:20.605613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 546/1096] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 08:00:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:20.611152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:20.679848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:20.709549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345058f1-b12f-4d8c-a44e-18a96e7809d9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:20.743309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:20.744089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.744392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.744665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.755062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:20.756509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:20.773608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:20.774808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:20.775726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:20.775726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:20.775726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:20.775726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:20.775726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 551/1097] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:20.780711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:20.800977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:20.878800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3496397-4cd4-42de-b893-d5bdee7059ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:20.912963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:20.913611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:20.913888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:20.914157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:20.914868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:20.915168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:20.916543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:20.928159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 547/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:20.933711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:21.031447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2691-abbe-42c5-a25b-7486706423cf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:21.053871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:21.064950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:21.065751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:21.066035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:21.066309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:21.073683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:21.075152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:00:21.089533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:21.090481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:21.091473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 552/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 08:00:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:21.097325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:21.173115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:21.194355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa58ab-0a65-477e-a1fe-77468b1bb702 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:21.228730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:21.229394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:21.229678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:21.229953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:21.230782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:21.231098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:21.232586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:21.249705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 548/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 08:00:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:21.255959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:21.358920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780cd9-68e4-46fc-8541-2207e8277f2c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:21.392266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cec68-91c4-445a-864e-660833d7feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:21.392903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cec68-91c4-445a-864e-660833d7feca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:21.394277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cec68-91c4-445a-864e-660833d7feca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:21.394629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cec68-91c4-445a-864e-660833d7feca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:21.442562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:21.461054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cec68-91c4-445a-864e-660833d7feca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:21.462414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cec68-91c4-445a-864e-660833d7feca None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:21.559328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 553/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:21.565128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:21.664628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc29cc-584e-4258-a244-41859ebe3941 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:21.698978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:21.699751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:21.700028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:21.700328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:21.702936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:21.719393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:21.719393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:21.729666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:21.730680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:21.731644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:00:21.731644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:21.731644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:00:21.731644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:21.731644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 549/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:21.736615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cec68-91c4-445a-864e-660833d7feca None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:21.818381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:21.836030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cec68-91c4-445a-864e-660833d7feca None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:21.870707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:21.871365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:21.871645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:21.871922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:21.872679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:21.872983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:21.874340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:21.886044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 554/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:21.891578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:21.989994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ee3b-0a18-4e78-8d3e-eaadcb328f97 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:22.023394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:22.024463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:22.024747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:22.025019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:22.031553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:22.033025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:00:22.046963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:22.048032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:22.048974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 550/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:00:22.054472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:22.152405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50fe7f-22f1-4a0b-a8fe-b6ee3559fef4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:22.186031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d9167-7ce8-4f4b-9ac0-ae40ee55751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:22.186683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9167-7ce8-4f4b-9ac0-ae40ee55751a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:22.186966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9167-7ce8-4f4b-9ac0-ae40ee55751a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:22.187244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9167-7ce8-4f4b-9ac0-ae40ee55751a None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:22.188025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d9167-7ce8-4f4b-9ac0-ae40ee55751a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:22.188368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d9167-7ce8-4f4b-9ac0-ae40ee55751a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:22.189794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d9167-7ce8-4f4b-9ac0-ae40ee55751a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:22.201931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 555/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:22.207684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:22.238265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfd29-86a4-403c-b821-c16618cce130 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:22.238533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfd29-86a4-403c-b821-c16618cce130 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:22.238808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfd29-86a4-403c-b821-c16618cce130 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:22.240245 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 556/1106] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:22.245155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f22b-b921-4dfd-9f06-9ef5eed2f43b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:22.245438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f22b-b921-4dfd-9f06-9ef5eed2f43b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:22.245713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f22b-b921-4dfd-9f06-9ef5eed2f43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:22.250618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:22.258008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:22.263660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6747f22b-b921-4dfd-9f06-9ef5eed2f43b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:22.264934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6747f22b-b921-4dfd-9f06-9ef5eed2f43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:22.309627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaa10a-d5ce-4dd9-9744-522c18f07c01 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:22.351190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:22.351637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 557/1107] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:22.352419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:22.352788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:22.353087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:22.353969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] RBAC: Adding query filter params (role.id=32e446f6c32f4fb9a9cbedd10ef67bdf, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=7602c632829d44179aa129c552d1870a) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:22.354291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:22.355741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:22.364220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 551/1108] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:22 2022] GET /identity/v3/role_assignments?user.id=7602c632829d44179aa129c552d1870a&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=32e446f6c32f4fb9a9cbedd10ef67bdf => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:22.376762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f22b-b921-4dfd-9f06-9ef5eed2f43b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:22.483429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f22b-b921-4dfd-9f06-9ef5eed2f43b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:22.513757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:22.520492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c90d51-5c60-4d7a-a9b5-86ef858ff61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:22.521303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90d51-5c60-4d7a-a9b5-86ef858ff61d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:22.521592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90d51-5c60-4d7a-a9b5-86ef858ff61d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:22.521869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90d51-5c60-4d7a-a9b5-86ef858ff61d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:22.523053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c90d51-5c60-4d7a-a9b5-86ef858ff61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:22.524807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c90d51-5c60-4d7a-a9b5-86ef858ff61d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:22.526463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 558/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:22.532437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:22.641496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97769-50b3-486a-b368-bc3a7c3d0701 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:22.655698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:22.677743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bac35-f3b9-4ec3-be04-32ff88806297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:22.678415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bac35-f3b9-4ec3-be04-32ff88806297 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:22.678692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bac35-f3b9-4ec3-be04-32ff88806297 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:22.678979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bac35-f3b9-4ec3-be04-32ff88806297 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:22.679664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bac35-f3b9-4ec3-be04-32ff88806297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:22.681109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bac35-f3b9-4ec3-be04-32ff88806297 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:22.811307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 552/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 08:00:22 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:24.892749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d744edf-b2d5-4013-a0d3-e13c25a4e40a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:24.893248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d744edf-b2d5-4013-a0d3-e13c25a4e40a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:24.893337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d744edf-b2d5-4013-a0d3-e13c25a4e40a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:24.894922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 559/1111] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:24.900370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f1b26-872a-47cd-bccd-b76b2f158880 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:24.900766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f1b26-872a-47cd-bccd-b76b2f158880 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:24.900931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f1b26-872a-47cd-bccd-b76b2f158880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:24.917720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-232f1b26-872a-47cd-bccd-b76b2f158880 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:24.918880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-232f1b26-872a-47cd-bccd-b76b2f158880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:24.983028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 553/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:25.007157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d744edf-b2d5-4013-a0d3-e13c25a4e40a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:25.105907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d744edf-b2d5-4013-a0d3-e13c25a4e40a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:25.138615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:25.139442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:25.139721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:25.139996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] PATH_INFO: `/v3/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:25.141491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] RBAC: Authorizing `identity:get_role(role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:25.142895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:25.144386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 560/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:25 2022] GET /identity/v3/roles/d8548213eacf423fb6e7c5832be20d3b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:25.150228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f1b26-872a-47cd-bccd-b76b2f158880 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:25.241183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:25.244533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f1b26-872a-47cd-bccd-b76b2f158880 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:25.279039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:25.280178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:25.280492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:25.280767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] PATH_INFO: `/v3/users/9a189ca55a524719aa4b6ecbe6560c06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:25.296853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] RBAC: Authorizing `identity:get_user(user_id=9a189ca55a524719aa4b6ecbe6560c06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:25.298284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:25.300125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 554/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:25 2022] GET /identity/v3/users/9a189ca55a524719aa4b6ecbe6560c06 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:25.305875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:25.372027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:25.404483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafba3-9b88-4004-86ed-392687e1b5c9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:25.438177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:25.438846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:25.439130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:25.439407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:25.505115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:25.506549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:25.569831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:25.604189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 561/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:25.610346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:25.710276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f37f-2a46-4b44-aef0-5c9d7d2f58c0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:25.742493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3fe46-d6f5-4174-9fcb-a7af0898af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:25.743358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3fe46-d6f5-4174-9fcb-a7af0898af01 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:25.743637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3fe46-d6f5-4174-9fcb-a7af0898af01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:25.743905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3fe46-d6f5-4174-9fcb-a7af0898af01 None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:25.745084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3fe46-d6f5-4174-9fcb-a7af0898af01 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e725529e345f4a54487ac507b6dc2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:25.746494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3fe46-d6f5-4174-9fcb-a7af0898af01 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:25.748284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 555/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:25 2022] GET /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:25.754995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:25.851562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3defa-e67a-4aed-a778-e3a17f5b92f1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:25.885362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92698bb3-ddd4-4540-a73a-6a9f84c697da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:25.886005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698bb3-ddd4-4540-a73a-6a9f84c697da None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:25.886288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698bb3-ddd4-4540-a73a-6a9f84c697da None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:25.886565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698bb3-ddd4-4540-a73a-6a9f84c697da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:25.887384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92698bb3-ddd4-4540-a73a-6a9f84c697da None admin] RBAC: Adding query filter params (role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=b07e725529e345f4a54487ac507b6dc2, user.id=9a189ca55a524719aa4b6ecbe6560c06) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:25.887695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92698bb3-ddd4-4540-a73a-6a9f84c697da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:25.889133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92698bb3-ddd4-4540-a73a-6a9f84c697da None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:25.895024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 562/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:25 2022] GET /identity/v3/role_assignments?user.id=9a189ca55a524719aa4b6ecbe6560c06&scope.project.id=b07e725529e345f4a54487ac507b6dc2&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:27.923147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a3930-2727-4fd9-ae39-13054f5595e7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:27.923694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a3930-2727-4fd9-ae39-13054f5595e7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:27.923694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a3930-2727-4fd9-ae39-13054f5595e7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:27.926237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 556/1118] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:27.931380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23538-c151-40a6-860f-3f2dae35d50d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:27.931769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23538-c151-40a6-860f-3f2dae35d50d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:27.931944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23538-c151-40a6-860f-3f2dae35d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:27.948438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e1e23538-c151-40a6-860f-3f2dae35d50d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:27.949615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1e23538-c151-40a6-860f-3f2dae35d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:27.974860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:28.014375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 563/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:00:28.038252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a3930-2727-4fd9-ae39-13054f5595e7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:28.063114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:28.137004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a3930-2727-4fd9-ae39-13054f5595e7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:28.169307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:28.170137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:28.170417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:28.170690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] PATH_INFO: `/v3/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:28.172135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] RBAC: Authorizing `identity:get_role(role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:28.173549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:28.175432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 557/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:28 2022] GET /identity/v3/roles/d8548213eacf423fb6e7c5832be20d3b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:28.181233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e23538-c151-40a6-860f-3f2dae35d50d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:28.278102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e23538-c151-40a6-860f-3f2dae35d50d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:28.311152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:28.312003 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:28.312310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:28.312587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] PATH_INFO: `/v3/users/9a189ca55a524719aa4b6ecbe6560c06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:28.313777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] RBAC: Authorizing `identity:get_user(user_id=9a189ca55a524719aa4b6ecbe6560c06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:28.315269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:28.316894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 564/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:28 2022] GET /identity/v3/users/9a189ca55a524719aa4b6ecbe6560c06 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:28.322431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:28.411728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:28.420052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb0feb-009e-48b5-bd5e-40663d47c76a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:28.452590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610220e-f244-4669-a4b6-4a6bd45cdada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:28.453370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610220e-f244-4669-a4b6-4a6bd45cdada None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:28.453653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610220e-f244-4669-a4b6-4a6bd45cdada None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:28.453927 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610220e-f244-4669-a4b6-4a6bd45cdada None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:28.455088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610220e-f244-4669-a4b6-4a6bd45cdada None admin] RBAC: Authorizing `identity:get_project(project_id=b07e725529e345f4a54487ac507b6dc2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:28.457037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610220e-f244-4669-a4b6-4a6bd45cdada None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:28.458695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 558/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:28 2022] GET /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:28.464484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:28.494814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:28.563916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb95d9-f8f0-4f80-a976-48a01e5fee33 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:28.599641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940984a-0eb9-4199-95be-0c9a83981b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:28.600555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940984a-0eb9-4199-95be-0c9a83981b26 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:28.600837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940984a-0eb9-4199-95be-0c9a83981b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:28.601112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940984a-0eb9-4199-95be-0c9a83981b26 None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2/users/9a189ca55a524719aa4b6ecbe6560c06/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:28.603291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940984a-0eb9-4199-95be-0c9a83981b26 None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e725529e345f4a54487ac507b6dc2, user_id=9a189ca55a524719aa4b6ecbe6560c06, role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:28.604757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940984a-0eb9-4199-95be-0c9a83981b26 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:28.714885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 565/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 08:00:28 2022] PUT /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2/users/9a189ca55a524719aa4b6ecbe6560c06/roles/d8548213eacf423fb6e7c5832be20d3b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:00:30.723157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72703ae-7bee-4f3f-be4f-e7f1b5f2613a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:30.723706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72703ae-7bee-4f3f-be4f-e7f1b5f2613a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:30.723706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72703ae-7bee-4f3f-be4f-e7f1b5f2613a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:30.725116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 559/1124] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:00:30.730439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743899-e71f-4843-a747-d41446b6b760 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:30.730839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743899-e71f-4843-a747-d41446b6b760 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:30.730997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743899-e71f-4843-a747-d41446b6b760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:30.748015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fe743899-e71f-4843-a747-d41446b6b760 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:30.749219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fe743899-e71f-4843-a747-d41446b6b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:30.813697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 566/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:30.838155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72703ae-7bee-4f3f-be4f-e7f1b5f2613a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:30.936742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72703ae-7bee-4f3f-be4f-e7f1b5f2613a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:30.968867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:30.970722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:30.970722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:30.970722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] PATH_INFO: `/v3/roles/d8548213eacf423fb6e7c5832be20d3b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:30.972189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] RBAC: Authorizing `identity:get_role(role_id=d8548213eacf423fb6e7c5832be20d3b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:30.973563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:30.974893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 560/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:30 2022] GET /identity/v3/roles/d8548213eacf423fb6e7c5832be20d3b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:30.980550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe743899-e71f-4843-a747-d41446b6b760 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:31.001715 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:31.077469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe743899-e71f-4843-a747-d41446b6b760 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:31.110912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:31.111702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:31.112019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:31.112865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] PATH_INFO: `/v3/users/9a189ca55a524719aa4b6ecbe6560c06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:31.114115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9a189ca55a524719aa4b6ecbe6560c06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:31.115527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:31.117171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 567/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:30 2022] GET /identity/v3/users/9a189ca55a524719aa4b6ecbe6560c06 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:31.122868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:31.150139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:31.219335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955edfd-8094-4b6e-ad77-a27e46f4967c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:31.252903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:31.253506 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:31.253792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:31.254068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:31.318715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:31.320141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:31.345910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:31.415363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 561/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:31.421143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:31.506725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:31.519126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034764b-308f-4622-b1d2-67c5744464f7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:31.553550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7c23d-b695-4643-8faa-29fdc0619d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:31.554395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7c23d-b695-4643-8faa-29fdc0619d00 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:31.554679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7c23d-b695-4643-8faa-29fdc0619d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:31.554957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7c23d-b695-4643-8faa-29fdc0619d00 None admin] PATH_INFO: `/v3/projects/b07e725529e345f4a54487ac507b6dc2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:31.556175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7c23d-b695-4643-8faa-29fdc0619d00 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e725529e345f4a54487ac507b6dc2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:31.557636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7c23d-b695-4643-8faa-29fdc0619d00 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:31.559336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 568/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:31 2022] GET /identity/v3/projects/b07e725529e345f4a54487ac507b6dc2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:31.565363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:31.663674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47882ecc-7217-4e9f-931f-6443447927d7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:31.688971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:31.697077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b7522-5f13-4ee8-b432-091b7e690c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:31.697720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7522-5f13-4ee8-b432-091b7e690c22 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:31.698005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7522-5f13-4ee8-b432-091b7e690c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:31.698285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7522-5f13-4ee8-b432-091b7e690c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:31.699110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7522-5f13-4ee8-b432-091b7e690c22 None admin] RBAC: Adding query filter params (role.id=d8548213eacf423fb6e7c5832be20d3b, scope.project.id=b07e725529e345f4a54487ac507b6dc2, user.id=9a189ca55a524719aa4b6ecbe6560c06) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:31.699424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7522-5f13-4ee8-b432-091b7e690c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:31.700903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7522-5f13-4ee8-b432-091b7e690c22 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:31.707250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 562/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:31 2022] GET /identity/v3/role_assignments?user.id=9a189ca55a524719aa4b6ecbe6560c06&scope.project.id=b07e725529e345f4a54487ac507b6dc2&role.id=d8548213eacf423fb6e7c5832be20d3b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:33.758859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076f00-33aa-4346-97dc-bbdef33e55f1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:33.759414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076f00-33aa-4346-97dc-bbdef33e55f1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:33.759414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076f00-33aa-4346-97dc-bbdef33e55f1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:33.760948 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 569/1131] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:33.766143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4e8d7-7836-4633-a976-0a39d88bb1b1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:33.766598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4e8d7-7836-4633-a976-0a39d88bb1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:33.766694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4e8d7-7836-4633-a976-0a39d88bb1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:33.783548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-19f4e8d7-7836-4633-a976-0a39d88bb1b1 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:33.784977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-19f4e8d7-7836-4633-a976-0a39d88bb1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:33.850923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 563/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:33.874843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076f00-33aa-4346-97dc-bbdef33e55f1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:33.975694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076f00-33aa-4346-97dc-bbdef33e55f1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:34.009415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8089-c552-408a-941c-534b0f66e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:34.010189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8089-c552-408a-941c-534b0f66e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:34.010467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8089-c552-408a-941c-534b0f66e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:34.010736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8089-c552-408a-941c-534b0f66e2a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:34.011899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8089-c552-408a-941c-534b0f66e2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:34.013348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8089-c552-408a-941c-534b0f66e2a4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:34.014959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 570/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:34.020735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4e8d7-7836-4633-a976-0a39d88bb1b1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:34.117198 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4e8d7-7836-4633-a976-0a39d88bb1b1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:34.138504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:34.149906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd306df-d505-4d01-86fc-fd8ed62223c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:34.150550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd306df-d505-4d01-86fc-fd8ed62223c8 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:34.150836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd306df-d505-4d01-86fc-fd8ed62223c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:34.152809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd306df-d505-4d01-86fc-fd8ed62223c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:34.152809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd306df-d505-4d01-86fc-fd8ed62223c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:34.153310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd306df-d505-4d01-86fc-fd8ed62223c8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:34.277234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 564/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 08:00:34 2022] POST /identity/v3/projects => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:36.339319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981738-dc2a-44cf-b144-34a5662a44f5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:36.339864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981738-dc2a-44cf-b144-34a5662a44f5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:36.339864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981738-dc2a-44cf-b144-34a5662a44f5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:36.341273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 571/1135] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:36.346408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714657-1480-4e93-a527-df52c6b05f37 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:36.346874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714657-1480-4e93-a527-df52c6b05f37 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:36.346874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714657-1480-4e93-a527-df52c6b05f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:36.363424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d714657-1480-4e93-a527-df52c6b05f37 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:36.364633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d714657-1480-4e93-a527-df52c6b05f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:36.428996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 565/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:36.454024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981738-dc2a-44cf-b144-34a5662a44f5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:36.478689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:36.552812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981738-dc2a-44cf-b144-34a5662a44f5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:36.585494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e31c7-46fe-427e-b4c5-d6245bb4909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:36.586272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e31c7-46fe-427e-b4c5-d6245bb4909d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:36.586553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e31c7-46fe-427e-b4c5-d6245bb4909d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:36.586826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e31c7-46fe-427e-b4c5-d6245bb4909d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:36.587975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e31c7-46fe-427e-b4c5-d6245bb4909d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:36.589474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e31c7-46fe-427e-b4c5-d6245bb4909d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:36.591030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 572/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:36.596708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714657-1480-4e93-a527-df52c6b05f37 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:36.692768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714657-1480-4e93-a527-df52c6b05f37 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:36.694998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:36.725625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183d1ad-6d37-4454-b2f7-351abe742a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:36.726280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183d1ad-6d37-4454-b2f7-351abe742a01 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:36.726563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183d1ad-6d37-4454-b2f7-351abe742a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:36.726840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183d1ad-6d37-4454-b2f7-351abe742a01 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:36.727538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183d1ad-6d37-4454-b2f7-351abe742a01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:36.728985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183d1ad-6d37-4454-b2f7-351abe742a01 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:36.886233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 566/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 08:00:36 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:38.968089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744200-493b-4a1b-b491-8ab121c0a7b1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:38.968627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744200-493b-4a1b-b491-8ab121c0a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:38.968627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744200-493b-4a1b-b491-8ab121c0a7b1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:38.970009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 573/1139] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:38.975780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea0b5-295f-4658-bc54-ea8718cf940b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:38.976230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea0b5-295f-4658-bc54-ea8718cf940b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:38.976351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea0b5-295f-4658-bc54-ea8718cf940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:38.992662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-831ea0b5-295f-4658-bc54-ea8718cf940b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:38.993831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-831ea0b5-295f-4658-bc54-ea8718cf940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:39.058206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 567/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:39.081805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02744200-493b-4a1b-b491-8ab121c0a7b1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:39.171789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:39.181095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02744200-493b-4a1b-b491-8ab121c0a7b1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:39.215349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:39.216113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:39.216417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:39.216688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:39.226877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:39.234304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:39.235485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:39.236740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 574/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:39.241575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea0b5-295f-4658-bc54-ea8718cf940b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:39.329375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:39.339153 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea0b5-295f-4658-bc54-ea8718cf940b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:39.370936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:39.371589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:39.371870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:39.372143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:39.372920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:39.373228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:39.374592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:39.383464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 568/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:39.389395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:39.489120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab105bf-ceed-4b52-8b77-78ede5e1e18e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:39.522508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:39.523355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:39.523631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:39.523905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] PATH_INFO: `/v3/users/3e73001014354c4a8808b7e856ce5796` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:39.537505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] RBAC: Authorizing `identity:get_user(user_id=3e73001014354c4a8808b7e856ce5796)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:39.538920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:39.540662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 575/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:39 2022] GET /identity/v3/users/3e73001014354c4a8808b7e856ce5796 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:39.546471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:39.645507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cd72e-71f6-44c6-a3e3-c3029d0aca1e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:39.677923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:39.678552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:39.678831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:39.679104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:39.699626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:39.744248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:39.745629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:39.839938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 569/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:39.845855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:39.858360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:39.944500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007e3f8-4c92-4270-be3e-79317d8e9c1b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:39.977679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf04fad-9ce0-4853-a6a6-d636bb566dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:39.978526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04fad-9ce0-4853-a6a6-d636bb566dcf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:39.978808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04fad-9ce0-4853-a6a6-d636bb566dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:39.979085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04fad-9ce0-4853-a6a6-d636bb566dcf None admin] PATH_INFO: `/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:39.980311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf04fad-9ce0-4853-a6a6-d636bb566dcf None admin] RBAC: Authorizing `identity:get_project(project_id=1a90ab20d77e473ea7f3c14885b44f1a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:39.981760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf04fad-9ce0-4853-a6a6-d636bb566dcf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:39.983457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 576/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:39 2022] GET /identity/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:39.990060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:40.040791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:40.086285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca5c4-9d70-47c1-85ba-38009b77f9fd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:40.119286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fee2d-e630-43b3-8fd1-5c49e61fbe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:40.119921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fee2d-e630-43b3-8fd1-5c49e61fbe72 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:40.120218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fee2d-e630-43b3-8fd1-5c49e61fbe72 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:40.120508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fee2d-e630-43b3-8fd1-5c49e61fbe72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:40.121328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fee2d-e630-43b3-8fd1-5c49e61fbe72 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=1a90ab20d77e473ea7f3c14885b44f1a, user.id=3e73001014354c4a8808b7e856ce5796) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:40.121639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fee2d-e630-43b3-8fd1-5c49e61fbe72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:40.123060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fee2d-e630-43b3-8fd1-5c49e61fbe72 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:40.128375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 570/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:39 2022] GET /identity/v3/role_assignments?user.id=3e73001014354c4a8808b7e856ce5796&scope.project.id=1a90ab20d77e473ea7f3c14885b44f1a&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:42.096059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3337fe-6618-484c-b727-d878d74eda20 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:42.097162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3337fe-6618-484c-b727-d878d74eda20 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:42.097265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3337fe-6618-484c-b727-d878d74eda20 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:42.098610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 577/1147] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:42.103839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6923b-448d-4417-9f5a-6e92d3f73357 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:42.104240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6923b-448d-4417-9f5a-6e92d3f73357 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:42.104428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6923b-448d-4417-9f5a-6e92d3f73357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:42.121685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-acb6923b-448d-4417-9f5a-6e92d3f73357 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:42.122838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-acb6923b-448d-4417-9f5a-6e92d3f73357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:42.187625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 571/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:42.210467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3337fe-6618-484c-b727-d878d74eda20 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:42.290181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:42.312237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3337fe-6618-484c-b727-d878d74eda20 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:42.345303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:42.346125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:42.346357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:42.347263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:42.357583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:42.366006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:42.367132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:42.368106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 578/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:42.373215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6923b-448d-4417-9f5a-6e92d3f73357 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:42.418272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:42.468871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6923b-448d-4417-9f5a-6e92d3f73357 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:42.502648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:42.503690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:42.503967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:42.504265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:42.504999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:42.505301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:42.506675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:42.514380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 572/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:42.521049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:42.622217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8752478-84fc-4c61-be6b-992b699f7996 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:42.655082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:42.655940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:42.656244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:42.656527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] PATH_INFO: `/v3/users/3e73001014354c4a8808b7e856ce5796` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:42.657706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] RBAC: Authorizing `identity:get_user(user_id=3e73001014354c4a8808b7e856ce5796)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:42.659728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:42.661389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 579/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:42 2022] GET /identity/v3/users/3e73001014354c4a8808b7e856ce5796 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:42.667303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:42.762715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885e3c-5478-4af8-b81a-e20bb230d32d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:42.771880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:42.796324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001c4a4-6571-442b-bdbf-a37ccb09b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:42.797163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c4a4-6571-442b-bdbf-a37ccb09b358 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:42.797441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c4a4-6571-442b-bdbf-a37ccb09b358 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:42.797717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c4a4-6571-442b-bdbf-a37ccb09b358 None admin] PATH_INFO: `/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:42.798878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001c4a4-6571-442b-bdbf-a37ccb09b358 None admin] RBAC: Authorizing `identity:get_project(project_id=1a90ab20d77e473ea7f3c14885b44f1a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:42.800446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001c4a4-6571-442b-bdbf-a37ccb09b358 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:42.802121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 573/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:42 2022] GET /identity/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:42.808047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:42.817495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:42.909117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d28478-1922-4c9c-b705-11eadbf121ff None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:42.944152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602693-28c5-4c5f-bf4f-b28f425f3736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:42.945164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602693-28c5-4c5f-bf4f-b28f425f3736 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:42.945442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602693-28c5-4c5f-bf4f-b28f425f3736 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:42.945711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602693-28c5-4c5f-bf4f-b28f425f3736 None admin] PATH_INFO: `/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a/users/3e73001014354c4a8808b7e856ce5796/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:42.948700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602693-28c5-4c5f-bf4f-b28f425f3736 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a90ab20d77e473ea7f3c14885b44f1a, user_id=3e73001014354c4a8808b7e856ce5796, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:42.950884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602693-28c5-4c5f-bf4f-b28f425f3736 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:43.062004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 580/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 08:00:42 2022] PUT /identity/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a/users/3e73001014354c4a8808b7e856ce5796/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:00:45.069017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbecc7-6505-44f9-9481-91b616b87d4f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:45.069531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbecc7-6505-44f9-9481-91b616b87d4f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:45.069638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbecc7-6505-44f9-9481-91b616b87d4f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:45.070942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 574/1154] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:45.076160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1c70-be07-4321-8905-3eee46207e87 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:45.076592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1c70-be07-4321-8905-3eee46207e87 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:45.076744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1c70-be07-4321-8905-3eee46207e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:45.094679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e71c1c70-be07-4321-8905-3eee46207e87 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:45.095856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e71c1c70-be07-4321-8905-3eee46207e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:45.154538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:45.161883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 581/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:45.185787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbecc7-6505-44f9-9481-91b616b87d4f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:45.287023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbecc7-6505-44f9-9481-91b616b87d4f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:45.319752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:45.320495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:45.320784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:45.321062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:45.331995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:45.339468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:45.342453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:45.343491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 575/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:45.346730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c1c70-be07-4321-8905-3eee46207e87 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:45.443121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c1c70-be07-4321-8905-3eee46207e87 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:45.475882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:45.476563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:45.476848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:45.477121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:45.477860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:45.478167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:45.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:45.487942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 582/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:45.493779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:45.528292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:45.592155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15401307-7ad8-46e7-a175-ed1315e6abfc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:45.625041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:45.625888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:45.626165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:45.626435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] PATH_INFO: `/v3/users/3e73001014354c4a8808b7e856ce5796` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:45.627594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] RBAC: Authorizing `identity:get_user(user_id=3e73001014354c4a8808b7e856ce5796)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:45.629773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:45.631387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 576/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:45 2022] GET /identity/v3/users/3e73001014354c4a8808b7e856ce5796 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:45.637216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:45.695639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:45.735971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175d89-a82a-412e-8355-6ca916c13cf3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:45.769090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:45.772731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:45.772731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:45.772731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:45.836756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:45.838119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:45.892167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:45.933710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 583/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:45.939697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:46.037318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de223-db1f-4a85-aca8-6ddef7a26efc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:46.039649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:46.070422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306058ca-64f8-41c2-9c71-a0ad4a9c6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:46.071260 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306058ca-64f8-41c2-9c71-a0ad4a9c6f21 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:46.071544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306058ca-64f8-41c2-9c71-a0ad4a9c6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:46.071821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306058ca-64f8-41c2-9c71-a0ad4a9c6f21 None admin] PATH_INFO: `/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:46.073105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306058ca-64f8-41c2-9c71-a0ad4a9c6f21 None admin] RBAC: Authorizing `identity:get_project(project_id=1a90ab20d77e473ea7f3c14885b44f1a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:46.074560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306058ca-64f8-41c2-9c71-a0ad4a9c6f21 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:46.076805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 577/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:45 2022] GET /identity/v3/projects/1a90ab20d77e473ea7f3c14885b44f1a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:00:46.082547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:46.178924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9699-df53-45d2-a31d-59b354349bb2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:46.212103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d225446-aeae-46d6-81a6-a073983d9770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:46.213111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225446-aeae-46d6-81a6-a073983d9770 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:46.213394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225446-aeae-46d6-81a6-a073983d9770 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:46.213670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225446-aeae-46d6-81a6-a073983d9770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:46.214496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225446-aeae-46d6-81a6-a073983d9770 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=1a90ab20d77e473ea7f3c14885b44f1a, user.id=3e73001014354c4a8808b7e856ce5796) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:46.214804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225446-aeae-46d6-81a6-a073983d9770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:46.216243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225446-aeae-46d6-81a6-a073983d9770 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:46.222899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 584/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:46 2022] GET /identity/v3/role_assignments?user.id=3e73001014354c4a8808b7e856ce5796&scope.project.id=1a90ab20d77e473ea7f3c14885b44f1a&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:48.272358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de30b0-ebbd-4a24-b02d-258921d9688d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:48.272901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de30b0-ebbd-4a24-b02d-258921d9688d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:48.272901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de30b0-ebbd-4a24-b02d-258921d9688d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:48.274279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 578/1162] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:48.279686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813069-a1f0-4907-8a5b-fac0d84a4f6a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:48.280060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813069-a1f0-4907-8a5b-fac0d84a4f6a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:48.280280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813069-a1f0-4907-8a5b-fac0d84a4f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:48.297088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-02813069-a1f0-4907-8a5b-fac0d84a4f6a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:48.298256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-02813069-a1f0-4907-8a5b-fac0d84a4f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:48.314845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:48.363782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 585/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:48.386338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de30b0-ebbd-4a24-b02d-258921d9688d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:48.485522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de30b0-ebbd-4a24-b02d-258921d9688d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:48.518206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:48.519366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:48.519654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:48.519928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:48.559158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:48.584934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:48.586369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:48.680779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 579/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:48.686771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02813069-a1f0-4907-8a5b-fac0d84a4f6a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:48.781960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02813069-a1f0-4907-8a5b-fac0d84a4f6a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:48.814791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196436e6-6f33-46dc-95b1-c72c8e93ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:48.815825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196436e6-6f33-46dc-95b1-c72c8e93ade4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:48.815942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196436e6-6f33-46dc-95b1-c72c8e93ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:48.816167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196436e6-6f33-46dc-95b1-c72c8e93ade4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:48.822613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196436e6-6f33-46dc-95b1-c72c8e93ade4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:48.824030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196436e6-6f33-46dc-95b1-c72c8e93ade4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-196436e6-6f33-46dc-95b1-c72c8e93ade4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:48.838266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:48.839484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:00:48.840698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 586/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 08:00:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:48.845158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:48.913426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:48.941572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc167a-733b-4fa6-9ad7-e963ed14bd0a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:48.974241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc11377-ddb3-4e43-ba3f-629cef07863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:48.974877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc11377-ddb3-4e43-ba3f-629cef07863a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:48.975154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc11377-ddb3-4e43-ba3f-629cef07863a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:48.975425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc11377-ddb3-4e43-ba3f-629cef07863a None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:48.976138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc11377-ddb3-4e43-ba3f-629cef07863a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:48.976467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc11377-ddb3-4e43-ba3f-629cef07863a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:48.977806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc11377-ddb3-4e43-ba3f-629cef07863a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:48.984679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 580/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 08:00:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:51.013650 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1b568-60ac-4a41-86b6-e8d6eb20a9b4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:51.014174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1b568-60ac-4a41-86b6-e8d6eb20a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:51.014267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1b568-60ac-4a41-86b6-e8d6eb20a9b4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:51.015647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 587/1167] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:51.021041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ecb47-adae-472f-98af-2dd753c2f92e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:51.021481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ecb47-adae-472f-98af-2dd753c2f92e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:51.021588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ecb47-adae-472f-98af-2dd753c2f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:51.038075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c47ecb47-adae-472f-98af-2dd753c2f92e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:51.039229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c47ecb47-adae-472f-98af-2dd753c2f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:51.102830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 581/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:51.126051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1b568-60ac-4a41-86b6-e8d6eb20a9b4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:51.141894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:51.227679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1b568-60ac-4a41-86b6-e8d6eb20a9b4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:51.260042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af4dd6-d9d1-4c4d-b0bb-23a63b84c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:51.260726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af4dd6-d9d1-4c4d-b0bb-23a63b84c926 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:51.261009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af4dd6-d9d1-4c4d-b0bb-23a63b84c926 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:51.261287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af4dd6-d9d1-4c4d-b0bb-23a63b84c926 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:51.262031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af4dd6-d9d1-4c4d-b0bb-23a63b84c926 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:51.263386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af4dd6-d9d1-4c4d-b0bb-23a63b84c926 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:51.354362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 588/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri Jun 24 08:00:51 2022] POST /identity/v3/domains => generated 267 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:53.440152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130036-3e36-4792-9798-5f37134a8ae8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:53.441223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130036-3e36-4792-9798-5f37134a8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:53.441318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130036-3e36-4792-9798-5f37134a8ae8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:53.442643 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 582/1170] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:53.447736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df06c-b2c4-4510-99ac-f2b12c6e8129 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:53.448121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df06c-b2c4-4510-99ac-f2b12c6e8129 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:53.448326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df06c-b2c4-4510-99ac-f2b12c6e8129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:53.465332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f82df06c-b2c4-4510-99ac-f2b12c6e8129 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:53.466503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f82df06c-b2c4-4510-99ac-f2b12c6e8129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:53.531315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 589/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:53.554724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130036-3e36-4792-9798-5f37134a8ae8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:53.621404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:53.656987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130036-3e36-4792-9798-5f37134a8ae8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:53.689846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3cffb-1734-450e-a797-81e951e79965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:53.691294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3cffb-1734-450e-a797-81e951e79965 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:53.691513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3cffb-1734-450e-a797-81e951e79965 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:53.691788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3cffb-1734-450e-a797-81e951e79965 None admin] PATH_INFO: `/v3/domains/02591aca31604a8fbf3c91c95d220622` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:53.701972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3cffb-1734-450e-a797-81e951e79965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=02591aca31604a8fbf3c91c95d220622)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:53.703424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3cffb-1734-450e-a797-81e951e79965 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:53.705086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 583/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Jun 24 08:00:53 2022] GET /identity/v3/domains/02591aca31604a8fbf3c91c95d220622 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:53.711836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df06c-b2c4-4510-99ac-f2b12c6e8129 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:53.714027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:53.808833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df06c-b2c4-4510-99ac-f2b12c6e8129 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:53.842367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543c6e-ffe9-46bc-b26f-d0a752af59c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:53.843006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543c6e-ffe9-46bc-b26f-d0a752af59c2 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:53.843281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543c6e-ffe9-46bc-b26f-d0a752af59c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:53.843551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543c6e-ffe9-46bc-b26f-d0a752af59c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:53.844261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38543c6e-ffe9-46bc-b26f-d0a752af59c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:53.845675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38543c6e-ffe9-46bc-b26f-d0a752af59c2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:53.966349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 590/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 08:00:53 2022] POST /identity/v3/projects => generated 361 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:00:56.060133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a302-e567-485f-b1b2-1700664e2f42 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:56.060703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a302-e567-485f-b1b2-1700664e2f42 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:56.060703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a302-e567-485f-b1b2-1700664e2f42 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:56.062110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 584/1174] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:56.068362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3dc0b-5b98-48dc-86e4-11c2b67171cf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:56.068764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3dc0b-5b98-48dc-86e4-11c2b67171cf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:56.068926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3dc0b-5b98-48dc-86e4-11c2b67171cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:56.085672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-40e3dc0b-5b98-48dc-86e4-11c2b67171cf None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:56.086829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-40e3dc0b-5b98-48dc-86e4-11c2b67171cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:56.135471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:56.152682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 591/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:56.180964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9a302-e567-485f-b1b2-1700664e2f42 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:56.294421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9a302-e567-485f-b1b2-1700664e2f42 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:56.321349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:56.329433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f639745-649f-43a5-9828-4340ea992aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:56.330280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639745-649f-43a5-9828-4340ea992aff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:56.330578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639745-649f-43a5-9828-4340ea992aff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:56.330885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f639745-649f-43a5-9828-4340ea992aff None admin] PATH_INFO: `/v3/domains/02591aca31604a8fbf3c91c95d220622` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:56.332539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f639745-649f-43a5-9828-4340ea992aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=02591aca31604a8fbf3c91c95d220622)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:56.337237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f639745-649f-43a5-9828-4340ea992aff None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:56.337237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 585/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Jun 24 08:00:56 2022] GET /identity/v3/domains/02591aca31604a8fbf3c91c95d220622 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:56.341475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3dc0b-5b98-48dc-86e4-11c2b67171cf None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:56.438908 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3dc0b-5b98-48dc-86e4-11c2b67171cf None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:56.471600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a832eb-718d-48c4-a8b1-1bf833063136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:56.472284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a832eb-718d-48c4-a8b1-1bf833063136 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:56.473105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a832eb-718d-48c4-a8b1-1bf833063136 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:56.473346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a832eb-718d-48c4-a8b1-1bf833063136 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:56.474057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a832eb-718d-48c4-a8b1-1bf833063136 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:56.475500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a832eb-718d-48c4-a8b1-1bf833063136 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:56.602515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 592/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 08:00:56 2022] POST /identity/v3/users => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:00:58.680595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6cf4-91cc-43d9-ae1b-9c447529e6c3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:58.681145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6cf4-91cc-43d9-ae1b-9c447529e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:58.681145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6cf4-91cc-43d9-ae1b-9c447529e6c3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:58.682503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 586/1178] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:00:58.687711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c825af-b595-498a-8b94-384c4469050a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:58.688132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c825af-b595-498a-8b94-384c4469050a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:58.688292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c825af-b595-498a-8b94-384c4469050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:58.704879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-14c825af-b595-498a-8b94-384c4469050a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:00:58.706047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-14c825af-b595-498a-8b94-384c4469050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:00:58.740224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:58.771319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 593/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:00:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:00:58.795602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6cf4-91cc-43d9-ae1b-9c447529e6c3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:58.893446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6cf4-91cc-43d9-ae1b-9c447529e6c3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:58.926501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:58.927269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:58.927547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:58.927817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:58.937921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:00:58.945496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:00:58.946703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:00:58.947843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 587/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:00:58.952567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c825af-b595-498a-8b94-384c4469050a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:59.049461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c825af-b595-498a-8b94-384c4469050a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:59.081747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:59.082990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:59.083272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:59.083545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:59.084311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:59.084617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:59.085976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:59.093782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 594/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:59.100130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:59.154543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:59.199740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24224c8-49ec-438c-bcb8-e04c4ebcfd84 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:59.234074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:59.234926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:59.235184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:59.235451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] PATH_INFO: `/v3/users/101d4464bad5406c8aafe80e8ee74d2f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:59.248012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] RBAC: Authorizing `identity:get_user(user_id=101d4464bad5406c8aafe80e8ee74d2f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:59.249457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:59.251065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 588/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:00:59 2022] GET /identity/v3/users/101d4464bad5406c8aafe80e8ee74d2f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:59.257172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:59.290046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:59.430854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5a17c-4ef0-48fa-be95-7eb579028940 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:59.463351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:59.463981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:59.464285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:59.464555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:59.527828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:59.529272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:59.559540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:59.629022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 595/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:00:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:00:59.636108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:59.732619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709dea4-7122-4203-a2fc-2511a1794d46 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:59.745821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:59.765545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28c99-ca96-4712-80e6-d57ea04e879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:59.766393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28c99-ca96-4712-80e6-d57ea04e879d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:59.766672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28c99-ca96-4712-80e6-d57ea04e879d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:59.766953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28c99-ca96-4712-80e6-d57ea04e879d None admin] PATH_INFO: `/v3/projects/76be6d899868416ba26aa75b20a1520d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:59.768119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28c99-ca96-4712-80e6-d57ea04e879d None admin] RBAC: Authorizing `identity:get_project(project_id=76be6d899868416ba26aa75b20a1520d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:59.769571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28c99-ca96-4712-80e6-d57ea04e879d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:59.771248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 589/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:00:59 2022] GET /identity/v3/projects/76be6d899868416ba26aa75b20a1520d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:00:59.777663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:00:59.874057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2a9a-beb4-4456-b965-d5e93155bc5b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:00:59.903086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:00:59.907739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203b597-42ae-4f12-9f42-92fc31573661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:00:59.908408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b597-42ae-4f12-9f42-92fc31573661 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:00:59.908688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b597-42ae-4f12-9f42-92fc31573661 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:00:59.908962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b597-42ae-4f12-9f42-92fc31573661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:00:59.909808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203b597-42ae-4f12-9f42-92fc31573661 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=76be6d899868416ba26aa75b20a1520d, user.id=101d4464bad5406c8aafe80e8ee74d2f) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:00:59.910113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203b597-42ae-4f12-9f42-92fc31573661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:00:59.911535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203b597-42ae-4f12-9f42-92fc31573661 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:00:59.917436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 596/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:00:59 2022] GET /identity/v3/role_assignments?user.id=101d4464bad5406c8aafe80e8ee74d2f&scope.project.id=76be6d899868416ba26aa75b20a1520d&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:01.909795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24dacc-1ee0-41c5-b31c-1728cb9d8768 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:01.910311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24dacc-1ee0-41c5-b31c-1728cb9d8768 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:01.910311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24dacc-1ee0-41c5-b31c-1728cb9d8768 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:01.911647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 590/1186] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:01:01.917464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b495b-78c8-4124-ae7f-5f783dcd79e3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:01.917899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b495b-78c8-4124-ae7f-5f783dcd79e3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:01.918020 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b495b-78c8-4124-ae7f-5f783dcd79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:01.934374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7d0b495b-78c8-4124-ae7f-5f783dcd79e3 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:01:01.935541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7d0b495b-78c8-4124-ae7f-5f783dcd79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:01:01.999646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 597/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:01:02.023271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24dacc-1ee0-41c5-b31c-1728cb9d8768 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:02.120505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24dacc-1ee0-41c5-b31c-1728cb9d8768 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:02.154288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:02.155055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:02.155335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:02.155609 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:02.165578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:01:02.173059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:01:02.174164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:01:02.175052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 591/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:01:02.180270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b495b-78c8-4124-ae7f-5f783dcd79e3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:02.276350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b495b-78c8-4124-ae7f-5f783dcd79e3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:02.300912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:02.309784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:02.310432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:02.310710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:02.310983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:02.311724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:01:02.312026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:02.313445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:02.321925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 598/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:02.327600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:02.369239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:02.426792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011170cc-60c8-4569-a693-d60d42c6e8a4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:02.460153 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:02.461055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:02.461343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:02.461621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] PATH_INFO: `/v3/users/101d4464bad5406c8aafe80e8ee74d2f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:02.462795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] RBAC: Authorizing `identity:get_user(user_id=101d4464bad5406c8aafe80e8ee74d2f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:02.464272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:02.465900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 592/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:01:02 2022] GET /identity/v3/users/101d4464bad5406c8aafe80e8ee74d2f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:02.471545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:02.568268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304d67f-d074-458a-ab2f-2c8ed4f3b95e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:02.601308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87adb7-c284-4e61-8a68-e54bc84f322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:02.602147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87adb7-c284-4e61-8a68-e54bc84f322c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:02.602424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87adb7-c284-4e61-8a68-e54bc84f322c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:02.602696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87adb7-c284-4e61-8a68-e54bc84f322c None admin] PATH_INFO: `/v3/projects/76be6d899868416ba26aa75b20a1520d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:02.603848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87adb7-c284-4e61-8a68-e54bc84f322c None admin] RBAC: Authorizing `identity:get_project(project_id=76be6d899868416ba26aa75b20a1520d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:02.605294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87adb7-c284-4e61-8a68-e54bc84f322c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:02.606970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 599/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:01:02 2022] GET /identity/v3/projects/76be6d899868416ba26aa75b20a1520d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:02.612781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:02.709722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bdd1-6c3d-4b83-918b-f2597c50365c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:02.718210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:02.742719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce81b98-30fe-4a10-9953-b30675bee969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:02.743594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce81b98-30fe-4a10-9953-b30675bee969 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:02.743875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce81b98-30fe-4a10-9953-b30675bee969 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:02.744146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce81b98-30fe-4a10-9953-b30675bee969 None admin] PATH_INFO: `/v3/projects/76be6d899868416ba26aa75b20a1520d/users/101d4464bad5406c8aafe80e8ee74d2f/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:02.746115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce81b98-30fe-4a10-9953-b30675bee969 None admin] RBAC: Authorizing `identity:create_grant(project_id=76be6d899868416ba26aa75b20a1520d, user_id=101d4464bad5406c8aafe80e8ee74d2f, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:02.747531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce81b98-30fe-4a10-9953-b30675bee969 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:02.818410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 593/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 08:01:02 2022] PUT /identity/v3/projects/76be6d899868416ba26aa75b20a1520d/users/101d4464bad5406c8aafe80e8ee74d2f/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:01:04.816736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d16a-9645-4af5-a6a7-4f0d3f1a332f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:04.817256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d16a-9645-4af5-a6a7-4f0d3f1a332f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:04.817256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d16a-9645-4af5-a6a7-4f0d3f1a332f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:04.818645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 600/1193] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:01:04.824337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2381-ae1a-4389-b141-3b460310b2f1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:04.824751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2381-ae1a-4389-b141-3b460310b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:04.824888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2381-ae1a-4389-b141-3b460310b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:04.841340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-726d2381-ae1a-4389-b141-3b460310b2f1 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:01:04.842440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-726d2381-ae1a-4389-b141-3b460310b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:01:04.906158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 594/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:01:04.930735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804d16a-9645-4af5-a6a7-4f0d3f1a332f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:04.992712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:05.052545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804d16a-9645-4af5-a6a7-4f0d3f1a332f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:05.084773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:05.085541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:05.085819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:05.086089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:05.095880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:01:05.103864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:01:05.104989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:01:05.105848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 601/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:01:05.111068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2381-ae1a-4389-b141-3b460310b2f1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:05.204033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:05.207703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2381-ae1a-4389-b141-3b460310b2f1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:05.240476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:05.243162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:05.243162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:05.243162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:05.243915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:01:05.244233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:05.245591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:05.253318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 595/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:05.259233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:05.357907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744b9d2-0835-4d81-af7b-fac5721c1519 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:05.373203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:05.389838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:05.390681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:05.390957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:05.391233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] PATH_INFO: `/v3/users/101d4464bad5406c8aafe80e8ee74d2f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:05.392481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] RBAC: Authorizing `identity:get_user(user_id=101d4464bad5406c8aafe80e8ee74d2f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:05.393871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:05.395473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 602/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 08:01:05 2022] GET /identity/v3/users/101d4464bad5406c8aafe80e8ee74d2f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:05.402154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:05.498603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76fea8-d6e7-4d10-b6c4-53bc377eb0f1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:05.530892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:05.531520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:05.531803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:05.532080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:05.558666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:05.598023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:05.599460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:05.696919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 596/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:01:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:01:05.702681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:05.800661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e49ee-8207-4842-ad55-d169fdaa073b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:05.833240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83db8c6-79cb-463c-b8cd-8c982b29661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:05.834075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db8c6-79cb-463c-b8cd-8c982b29661d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:05.834350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db8c6-79cb-463c-b8cd-8c982b29661d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:05.835729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db8c6-79cb-463c-b8cd-8c982b29661d None admin] PATH_INFO: `/v3/projects/76be6d899868416ba26aa75b20a1520d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:05.836920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83db8c6-79cb-463c-b8cd-8c982b29661d None admin] RBAC: Authorizing `identity:get_project(project_id=76be6d899868416ba26aa75b20a1520d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:05.838327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83db8c6-79cb-463c-b8cd-8c982b29661d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:05.839977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 603/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 08:01:05 2022] GET /identity/v3/projects/76be6d899868416ba26aa75b20a1520d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:05.845937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:01:05.903484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:05.941354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9b8de-142a-42fe-9ca4-aca74a33ec9a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:01:05.974980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ab75c-96ca-4324-ba0c-a6d3694cfac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:01:05.975614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab75c-96ca-4324-ba0c-a6d3694cfac2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:01:05.975887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab75c-96ca-4324-ba0c-a6d3694cfac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:01:05.976159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab75c-96ca-4324-ba0c-a6d3694cfac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:01:05.977070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ab75c-96ca-4324-ba0c-a6d3694cfac2 None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=76be6d899868416ba26aa75b20a1520d, user.id=101d4464bad5406c8aafe80e8ee74d2f) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:01:05.977378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ab75c-96ca-4324-ba0c-a6d3694cfac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:01:05.978795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ab75c-96ca-4324-ba0c-a6d3694cfac2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:01:05.984468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 597/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:01:05 2022] GET /identity/v3/role_assignments?user.id=101d4464bad5406c8aafe80e8ee74d2f&scope.project.id=76be6d899868416ba26aa75b20a1520d&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:01:15.829314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=74 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:01:15.981914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=38 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:24.795590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e5bd1-939b-4b93-8987-f7b6adb471b1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:24.796169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e5bd1-939b-4b93-8987-f7b6adb471b1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:24.796169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e5bd1-939b-4b93-8987-f7b6adb471b1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:24.797558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 604/1201] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:24.802703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb075e-6a4f-435d-a220-d190c7698753 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:24.803702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb075e-6a4f-435d-a220-d190c7698753 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:24.803702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb075e-6a4f-435d-a220-d190c7698753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:24.820338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c1eb075e-6a4f-435d-a220-d190c7698753 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:24.821507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c1eb075e-6a4f-435d-a220-d190c7698753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:24.888256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 598/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:24.913453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e5bd1-939b-4b93-8987-f7b6adb471b1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:25.013832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e5bd1-939b-4b93-8987-f7b6adb471b1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:25.047873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:25.048708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:25.048991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:25.049266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:25.060096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:25.064547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:25.078659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:25.079834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:25.081722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:25.081722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:25.081722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:25.081722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:25.081722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 605/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:25.086351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb075e-6a4f-435d-a220-d190c7698753 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:25.184172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb075e-6a4f-435d-a220-d190c7698753 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:25.213721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:25.219479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3190ef4-09c7-4562-a994-c66dc275b8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:25.220129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3190ef4-09c7-4562-a994-c66dc275b8fb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:25.220436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3190ef4-09c7-4562-a994-c66dc275b8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:25.220709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3190ef4-09c7-4562-a994-c66dc275b8fb None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:25.221415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3190ef4-09c7-4562-a994-c66dc275b8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:25.222811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3190ef4-09c7-4562-a994-c66dc275b8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:25.224172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3190ef4-09c7-4562-a994-c66dc275b8fb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:25.234929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 599/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:25.241001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:25.294561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:25.341253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a9dde-f38d-47e7-9a89-ad46b493fc9a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:25.373371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b0fd-a689-4b4b-9fb5-c707162ed2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:25.378368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b0fd-a689-4b4b-9fb5-c707162ed2f7 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:25.378368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b0fd-a689-4b4b-9fb5-c707162ed2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:25.378368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b0fd-a689-4b4b-9fb5-c707162ed2f7 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:25.378368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b0fd-a689-4b4b-9fb5-c707162ed2f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:25.378368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b0fd-a689-4b4b-9fb5-c707162ed2f7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:25.486251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 606/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 08:02:25 2022] POST /identity/v3/users => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:02:27.562039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec73ab-dc39-4375-9f05-112c3d9d5d05 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:27.562638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec73ab-dc39-4375-9f05-112c3d9d5d05 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:27.562638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec73ab-dc39-4375-9f05-112c3d9d5d05 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:27.564013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 600/1206] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:27.569698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e0830-10d5-4aaa-9bfc-6106c7cc8e73 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:27.570121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e0830-10d5-4aaa-9bfc-6106c7cc8e73 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:27.570254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e0830-10d5-4aaa-9bfc-6106c7cc8e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:27.587884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cf1e0830-10d5-4aaa-9bfc-6106c7cc8e73 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:27.593099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cf1e0830-10d5-4aaa-9bfc-6106c7cc8e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:27.655168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 607/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:27.678976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec73ab-dc39-4375-9f05-112c3d9d5d05 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:27.781903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec73ab-dc39-4375-9f05-112c3d9d5d05 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:27.814530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:27.815785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:27.816172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:27.816651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:27.828069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:02:27.836528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:27.837642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:27.838549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 601/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 08:02:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:27.843890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e0830-10d5-4aaa-9bfc-6106c7cc8e73 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:27.883555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:27.942832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e0830-10d5-4aaa-9bfc-6106c7cc8e73 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:27.977299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:27.977958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:27.978239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:27.978517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:27.979262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:27.979561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:27.980955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:27.988836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 608/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 08:02:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:27.994623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:28.046783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:28.094427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca249-bff2-4e43-9ae4-f11113ff47ca None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:28.126301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:28.127136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:28.127415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:28.127692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:28.137447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:28.138921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:28.156569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:28.157628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:28.158801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:28.158801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:28.158801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:28.158801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:28.158801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 602/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:28.164623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:28.262596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:28.265583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b0b50-f7fb-48ad-b08a-d0fc182ac0eb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:28.298985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:28.299631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:28.300492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:28.300771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:28.301488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:28.301792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:28.303140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:28.314409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 609/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:28.320665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:28.422493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b96205-bbbf-4c37-b430-d855e7c85cba None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:28.423931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:28.455304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:28.456239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:28.456527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:28.456801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:28.463569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:28.465020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:02:28.479516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:28.486084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:28.487921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 603/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:02:28.488732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:28.587675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e1f9-3d13-4434-b873-9cfd4109418e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:28.622344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:28.623026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:28.623308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:28.623577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:28.624426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:28.624730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:28.626131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:28.643202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 610/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 08:02:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:28.649076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:28.749351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4264dca-c0c5-4814-a6c5-35c0f464c68f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:28.783070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:28.783728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:28.784002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:28.784900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:28.814004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:28.851470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:28.852945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:28.946984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 604/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:02:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:02:28.952934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:28.973067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:29.052254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e008c-02b1-44c9-b28b-5f329c47a0c6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:29.087290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:29.088068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:29.088412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:29.088689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:29.098336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:29.099790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:29.116799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:29.117927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:29.119162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:29.119162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:29.119162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:29.119162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:29.119162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 611/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:29.123762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:29.184131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:29.222288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17460-faaa-4f2a-b7fd-6dc954a2778e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:29.256052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:29.256745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:29.257027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:29.257303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:29.258020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:29.258329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:29.259727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:29.271487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 605/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:29.277258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:29.346876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:29.376981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbb03b-6388-476b-858e-08be717b6ca2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:29.412106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:29.412918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:29.413198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:29.413470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:29.420291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:29.421730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:02:29.435840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:29.436938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:29.438049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 612/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:29.442984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:29.542385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c44c-d87f-41d1-afc0-9eb3edc24390 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:29.564557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:29.576472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84ce0a-38a5-475d-b3d6-9c32d6ce1e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:29.577142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ce0a-38a5-475d-b3d6-9c32d6ce1e33 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:29.577429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ce0a-38a5-475d-b3d6-9c32d6ce1e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:29.577709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ce0a-38a5-475d-b3d6-9c32d6ce1e33 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:29.578492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ce0a-38a5-475d-b3d6-9c32d6ce1e33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:29.578807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ce0a-38a5-475d-b3d6-9c32d6ce1e33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:29.580260 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ce0a-38a5-475d-b3d6-9c32d6ce1e33 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:29.593549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 606/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:29.600143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:29.698715 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb68df-86d0-4d78-a2eb-c61d127e4b05 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:29.727792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:29.733408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecb5ce-0448-4914-ad57-26312412c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:29.734051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb5ce-0448-4914-ad57-26312412c104 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:29.734329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb5ce-0448-4914-ad57-26312412c104 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:29.734601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb5ce-0448-4914-ad57-26312412c104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:29.735413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecb5ce-0448-4914-ad57-26312412c104 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=a535c818476847f5bfe081a66a239331) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:29.735717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecb5ce-0448-4914-ad57-26312412c104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:29.737165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecb5ce-0448-4914-ad57-26312412c104 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:29.742903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 613/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:02:29 2022] GET /identity/v3/role_assignments?user.id=a535c818476847f5bfe081a66a239331&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:31.762018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762aac-3d3b-4449-b05e-2721ea0f4a23 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:31.762576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762aac-3d3b-4449-b05e-2721ea0f4a23 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:31.762576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762aac-3d3b-4449-b05e-2721ea0f4a23 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:31.763996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 607/1220] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:31.769714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7360-d145-4a5e-9b07-5a1454b27751 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:31.770168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7360-d145-4a5e-9b07-5a1454b27751 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:31.770296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7360-d145-4a5e-9b07-5a1454b27751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:31.787627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7c0b7360-d145-4a5e-9b07-5a1454b27751 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:31.788824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7c0b7360-d145-4a5e-9b07-5a1454b27751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:31.855363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 614/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:31.878021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762aac-3d3b-4449-b05e-2721ea0f4a23 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:31.978684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762aac-3d3b-4449-b05e-2721ea0f4a23 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:32.011904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:32.012713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:32.013000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:32.013273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:32.024431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:02:32.032483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:32.033590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:32.035641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 608/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 08:02:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:32.040788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7360-d145-4a5e-9b07-5a1454b27751 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:32.140776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7360-d145-4a5e-9b07-5a1454b27751 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:32.164504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:32.174798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:32.175446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:32.175731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:32.176112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:32.176929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:32.177234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:32.178588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:32.186462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 615/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 08:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:32.193217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:32.236739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:32.293007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd009ae-ca8b-452b-b2a8-7ff9bbbcb7c4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:32.327181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:32.328002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:32.328317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:32.328591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:32.340539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:32.341972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:32.358682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:32.359875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:32.361025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:32.361025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:32.361025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:32.361025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:32.361025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 609/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:32.366169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:32.467009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba491a3-83c2-499e-9c81-970558c207c8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:32.500099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:32.500771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:32.501053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:32.501326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:32.502033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:32.502333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:32.503698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:32.515271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 616/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:32.521617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:32.615108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:32.621535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f8e64-87cc-4a5b-8916-1ad85decce03 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:32.654018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:32.655071 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:32.655355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:32.655628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:32.663611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:32.665076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:02:32.679030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:32.683762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:32.685108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 610/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:32.686140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:32.733238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:32.783786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119d178-b934-40fa-99e7-744ed54cf329 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:32.817979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:32.818621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:32.818903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:32.819179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:32.819999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:32.820333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:32.831691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:32.839016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 617/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 08:02:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:32.844618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:32.943117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb5e3-8149-44d9-abe6-0b2b7ff2e6a6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:32.975729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:32.976535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:32.976820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:32.977097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:32.988024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:32.989540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:33.006362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:33.007408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:33.008649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:33.008649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:33.008649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:33.008649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:33.008649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 611/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:02:33.013198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:33.110384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd269ea-af1a-4e6c-96b6-b3a2ca745057 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:33.113393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:33.143768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:33.144597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:33.144878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:33.145157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:33.145876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:33.146180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:33.147535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:33.158906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 618/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:33.165210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:33.174487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:33.261442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411642-9beb-4f3e-9ea0-f441ae5a72f0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:33.294625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:33.295401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:33.295684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:33.295956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:33.302685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:33.304210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:02:33.318092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:33.319152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:33.320457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 612/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:33.325094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:33.428019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea33970-67ba-48d4-9372-902c22348d4f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:33.460633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506e194-e301-4624-861c-6b893cb30a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:33.461284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e194-e301-4624-861c-6b893cb30a14 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:33.461562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e194-e301-4624-861c-6b893cb30a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:33.461835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e194-e301-4624-861c-6b893cb30a14 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:33.462608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506e194-e301-4624-861c-6b893cb30a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:33.462911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506e194-e301-4624-861c-6b893cb30a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:33.464348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506e194-e301-4624-861c-6b893cb30a14 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:33.476585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 619/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:33.482605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:33.547994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:33.582084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9130d5-3dc8-4887-9193-76886da3c837 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:33.614436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dfdb2-e0c7-4f75-93b3-1160055a26c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:33.615311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dfdb2-e0c7-4f75-93b3-1160055a26c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:33.615592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dfdb2-e0c7-4f75-93b3-1160055a26c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:33.615870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dfdb2-e0c7-4f75-93b3-1160055a26c1 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/a535c818476847f5bfe081a66a239331/roles/f40fb8f3b0f14a92a30b875528b909f4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:33.630884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dfdb2-e0c7-4f75-93b3-1160055a26c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=a535c818476847f5bfe081a66a239331, role_id=f40fb8f3b0f14a92a30b875528b909f4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:33.632340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dfdb2-e0c7-4f75-93b3-1160055a26c1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:33.752504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 613/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 08:02:33 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/a535c818476847f5bfe081a66a239331/roles/f40fb8f3b0f14a92a30b875528b909f4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:02:35.766696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297758f8-6a95-4112-b26a-abeddd4c9c7f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:35.767248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297758f8-6a95-4112-b26a-abeddd4c9c7f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:35.767248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297758f8-6a95-4112-b26a-abeddd4c9c7f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:35.769203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 620/1233] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:35.774766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59875784-fdcc-4288-bcc5-1905f9778cf7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:35.778052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59875784-fdcc-4288-bcc5-1905f9778cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:35.778052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59875784-fdcc-4288-bcc5-1905f9778cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:35.792653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-59875784-fdcc-4288-bcc5-1905f9778cf7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:35.793849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-59875784-fdcc-4288-bcc5-1905f9778cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:35.859843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 614/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:35.884580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297758f8-6a95-4112-b26a-abeddd4c9c7f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:35.911560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:35.985510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297758f8-6a95-4112-b26a-abeddd4c9c7f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:36.018422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:36.019462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:36.019742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:36.020012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:36.029958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:02:36.038166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:36.039294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:36.040170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 621/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 08:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:36.050935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59875784-fdcc-4288-bcc5-1905f9778cf7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:36.091550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:36.144423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59875784-fdcc-4288-bcc5-1905f9778cf7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:36.179123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:36.179795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:36.180081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:36.180391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:36.181163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:36.181473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:36.182879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:36.191814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 615/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 08:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:36.197504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:36.280952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:36.296454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36e5b2-b38e-422d-a4de-4df050d1fcf5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:36.328042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:36.328842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:36.329124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:36.329396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:36.340163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:36.341617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:36.358741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:36.359825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:36.360924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:36.360924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:36.360924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:36.360924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:36.360924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 622/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:36.365818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:36.465431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67788257-a4f0-4ff6-b815-b415dbfe7ee1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:36.475143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:36.498971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:36.499621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:36.499901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:36.500174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:36.504183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:36.504183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:36.504183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:36.513545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 616/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:02:36.520676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:36.623190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe51555-9c56-4b63-ad38-732810135777 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:36.657366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:36.658156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:36.658438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:36.658708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:36.661494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:36.666503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:36.669328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:02:36.682491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:36.683595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:36.684663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 623/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:36.689446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:36.786880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930520a-a6fb-456c-b8ec-cd6de178b6ea None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:36.819721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:36.820408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:36.820694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:36.820966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:36.821792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:36.822099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:36.823515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:36.841058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 617/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 08:02:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:36.846937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:36.947965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15df06b-f6f3-4e9e-aa37-190e610c9be1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:36.981380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:36.982016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:36.982296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:36.982572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:37.047381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:37.054167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:37.055615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:37.163235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 624/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:02:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:02:37.169062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:37.196252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:37.266093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d9ffb-7ca1-4880-afe0-73ffd3537a71 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:37.299425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:37.300359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:37.300729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:37.301006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:37.311069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:37.312558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:37.331727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:37.332973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:37.334072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:37.334072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:37.334072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:37.334072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:37.334072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 618/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:37.338575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:37.432343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:37.437893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593546e-3247-4493-8fe1-3095a89d8448 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:37.473581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:37.474247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:37.474531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:37.474810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:37.475535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:37.475842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:37.477302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:37.489698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 625/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:37.495497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:37.573633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:37.595343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17d441-8161-445c-8766-517aa061aa6a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:37.629152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:37.629930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:37.630215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:37.630487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:37.636849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:37.638279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:02:37.651692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:37.652781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:37.653730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 619/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:37.659109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:37.759166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1db6a-8120-4116-9446-391406e8ad10 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:37.793820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b156154-1056-4acd-b98c-9185a89df387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:37.794470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156154-1056-4acd-b98c-9185a89df387 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:37.794783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156154-1056-4acd-b98c-9185a89df387 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:37.795062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156154-1056-4acd-b98c-9185a89df387 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:37.795841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b156154-1056-4acd-b98c-9185a89df387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:37.796148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b156154-1056-4acd-b98c-9185a89df387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:37.797588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b156154-1056-4acd-b98c-9185a89df387 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:37.810587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 626/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:37.817292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:37.916435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a229-6ce6-49a1-8171-8728ef57be4d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:37.949274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce8ab2-ab81-4166-ac27-1c768399e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:37.949917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce8ab2-ab81-4166-ac27-1c768399e338 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:37.950201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce8ab2-ab81-4166-ac27-1c768399e338 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:37.950477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce8ab2-ab81-4166-ac27-1c768399e338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:37.951292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce8ab2-ab81-4166-ac27-1c768399e338 None admin] RBAC: Adding query filter params (role.id=f40fb8f3b0f14a92a30b875528b909f4, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=a535c818476847f5bfe081a66a239331) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:37.951603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce8ab2-ab81-4166-ac27-1c768399e338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:37.953060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce8ab2-ab81-4166-ac27-1c768399e338 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:37.959641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 620/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:02:37 2022] GET /identity/v3/role_assignments?user.id=a535c818476847f5bfe081a66a239331&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=f40fb8f3b0f14a92a30b875528b909f4 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:40.044094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9981ef-5a3d-4339-9c44-f5603c1d9715 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:40.045177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9981ef-5a3d-4339-9c44-f5603c1d9715 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:40.045177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9981ef-5a3d-4339-9c44-f5603c1d9715 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:40.046056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 627/1247] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:40.051332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80badf3-b65b-4de4-9e1e-2c0569646f38 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:40.051748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80badf3-b65b-4de4-9e1e-2c0569646f38 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:40.051907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80badf3-b65b-4de4-9e1e-2c0569646f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:40.057176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:40.068988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a80badf3-b65b-4de4-9e1e-2c0569646f38 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:40.070188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a80badf3-b65b-4de4-9e1e-2c0569646f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:40.138984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 621/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:40.164250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9981ef-5a3d-4339-9c44-f5603c1d9715 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:40.181921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:40.262542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9981ef-5a3d-4339-9c44-f5603c1d9715 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:40.298585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:40.298585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:40.298585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:40.298894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:40.308572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:02:40.316788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:40.317895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:40.318938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 628/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:40.323961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80badf3-b65b-4de4-9e1e-2c0569646f38 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:40.422081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80badf3-b65b-4de4-9e1e-2c0569646f38 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:40.451300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:40.455996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:40.456713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:40.456991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:40.457266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:40.458103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:40.458415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:40.459800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:40.467632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 622/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:40.473973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:40.552260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:40.574759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774c7b-c4c9-499d-8ac2-5fc4b399f2d5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:40.608260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:40.609053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:40.609339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:40.609618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:40.620731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:40.622170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:40.639226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:40.640269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:40.641625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:40.641625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:40.641625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:40.641625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:40.641625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 629/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:40.646415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:40.751933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc3c4d-276f-45f5-88fe-366de8530e61 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:40.785931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:40.786596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:40.786866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:40.787138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:40.787858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:40.788152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:40.789532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:40.801254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 623/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:40.806988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:40.907727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795e11-991a-4d86-8b7d-ed942b4a684f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:40.933967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:40.941597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:40.942376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:40.942660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:40.942932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:40.950272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:40.951742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:02:40.966129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:40.967173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:40.968241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 630/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:40.974089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:41.029666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:41.072909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9991d-11c2-4f47-a37e-84f37a4495c7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:41.105679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:41.112296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:41.112296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:41.112296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:41.112296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:41.112296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:41.112296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:41.126075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 624/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 08:02:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:41.132538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:41.232935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c8ede-5c1b-43f4-9fd9-e1ead88c8753 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:41.266207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:41.266839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:41.267115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:41.267385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:41.322570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:41.335160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:41.336619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:41.435122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 631/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:02:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:02:41.440954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:41.540215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b32582-b68c-47b5-a8df-8be85d96cf2a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:41.553293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:41.573646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:41.574445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:41.574725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:41.574998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:41.585985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:41.587364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:41.605189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:41.606167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:41.607098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:41.607098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:41.607098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:41.607098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:41.607098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 625/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:41.612177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:41.697484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:41.709968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973d78-98e4-4dad-9a8d-877f69b32dc0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:41.743299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:41.743953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:41.744264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:41.744545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:41.745268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:41.745641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:41.747030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:41.758193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 632/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:41.763796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:41.862220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27940b-1add-4417-bd36-10ca7dee921c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:41.896128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:41.896933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:41.897215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:41.897491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:41.903999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:41.905820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:02:41.919930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:41.924429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:41.926457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 626/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:41.927543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:42.027381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee38fdd-7577-4701-acf8-a9a6c9dfe41a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:42.062598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edceff0e-5dd8-4312-a7f6-2b4e90cee1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:42.076188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceff0e-5dd8-4312-a7f6-2b4e90cee1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:42.076188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceff0e-5dd8-4312-a7f6-2b4e90cee1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:42.076188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceff0e-5dd8-4312-a7f6-2b4e90cee1f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:42.076188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edceff0e-5dd8-4312-a7f6-2b4e90cee1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:42.076188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edceff0e-5dd8-4312-a7f6-2b4e90cee1f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:42.076188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edceff0e-5dd8-4312-a7f6-2b4e90cee1f8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:42.078943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 633/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:42.085220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:42.111239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:42.184710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56331-2247-4cfa-bcbd-ea98bbaf0d66 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:42.218098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a32ec-3f07-40e4-8049-6bb753dfc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:42.218741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a32ec-3f07-40e4-8049-6bb753dfc3ff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:42.219023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a32ec-3f07-40e4-8049-6bb753dfc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:42.219298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a32ec-3f07-40e4-8049-6bb753dfc3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:42.220123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a32ec-3f07-40e4-8049-6bb753dfc3ff None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=a535c818476847f5bfe081a66a239331) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:42.220464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a32ec-3f07-40e4-8049-6bb753dfc3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:42.222497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a32ec-3f07-40e4-8049-6bb753dfc3ff None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:42.227971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 627/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:02:42 2022] GET /identity/v3/role_assignments?user.id=a535c818476847f5bfe081a66a239331&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:44.249167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8ce4-c8cf-4b85-b2dc-6ae4b7bec33c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:44.249696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8ce4-c8cf-4b85-b2dc-6ae4b7bec33c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:44.249696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8ce4-c8cf-4b85-b2dc-6ae4b7bec33c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:44.251098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 634/1261] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:44.256987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6caaa6-fbdf-4f58-887f-ccba6c8d8cb3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:44.257408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6caaa6-fbdf-4f58-887f-ccba6c8d8cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:44.257546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6caaa6-fbdf-4f58-887f-ccba6c8d8cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:44.274703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6e6caaa6-fbdf-4f58-887f-ccba6c8d8cb3 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:44.275878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6e6caaa6-fbdf-4f58-887f-ccba6c8d8cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:44.341678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 628/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:44.364393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8ce4-c8cf-4b85-b2dc-6ae4b7bec33c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:44.375269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:44.466119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8ce4-c8cf-4b85-b2dc-6ae4b7bec33c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:44.499240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:44.499962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:44.500279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:44.500559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:44.510634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:02:44.518214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:44.519869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:44.521019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 635/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:44.526685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6caaa6-fbdf-4f58-887f-ccba6c8d8cb3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:44.545397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:44.625893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6caaa6-fbdf-4f58-887f-ccba6c8d8cb3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:44.661038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:44.661698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:44.662015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:44.662301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:44.663040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:44.663344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:44.664767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:44.672734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 629/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:44.678642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:44.747012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:44.779670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105690b-a109-453e-b19a-7579536bef0a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:44.812951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:44.813729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:44.814008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:44.814282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:44.825181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:44.826602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:44.844087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:44.848763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:44.849704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:44.849704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:44.849704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:44.849704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:44.849704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 636/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:44.851896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:44.933514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:44.952062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edf31-7f30-424d-82da-c27fd8c9aa45 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:44.984285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:44.984930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:44.985209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:44.985478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:44.986234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:44.986536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:44.988512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:44.999823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 630/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:45.005780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:45.106492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef682f69-1e53-46a0-b11c-8352f33ce2e6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:45.126048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:45.139976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:45.140799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:45.142993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:45.142993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:45.149493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:45.150921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:02:45.165694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:45.166642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:45.167728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 637/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:45.172762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:45.271989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbfa7-e015-4ba0-b036-4bdf0b5f4e69 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:45.306248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:45.306906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:45.307182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:45.307455 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:45.308307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:45.308618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:45.310045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:45.319781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:45.328088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 631/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 08:02:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:45.334763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:45.434341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b48908-0676-4514-80ae-4f0085e4d5f9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:45.466752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:45.467522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:45.467804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:45.468078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:45.479006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:45.489742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:45.496976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:45.498054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:45.499170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:45.499170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:45.499170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:45.499170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:45.499170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 638/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:45.504647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:45.604450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a884332-262a-4351-ba25-bdd656a0fb24 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:45.637771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:45.638417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:45.638823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:45.639101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:45.639812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:45.640116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:45.641493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:45.653129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 632/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:45.659578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:45.691021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:45.757967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d74da-5354-4e5e-9002-9a0617ba463e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:45.790898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:45.791677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:45.791960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:45.792270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:45.798804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:45.800320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:02:45.814182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:45.815254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:45.817016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 639/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:45.822639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:45.883310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:45.924901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfeffa-6be3-48dd-adef-036fc01793de None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:45.959228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94f3f-af4d-44b8-b88c-d0b484130079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:45.959811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94f3f-af4d-44b8-b88c-d0b484130079 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:45.960094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94f3f-af4d-44b8-b88c-d0b484130079 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:45.960405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94f3f-af4d-44b8-b88c-d0b484130079 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:45.961187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b94f3f-af4d-44b8-b88c-d0b484130079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:45.961495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b94f3f-af4d-44b8-b88c-d0b484130079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:45.963011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b94f3f-af4d-44b8-b88c-d0b484130079 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:45.976418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 633/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:45.982401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:46.077268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:46.085970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599792-522d-4da1-8bd2-e3184372cace None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:46.119769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad868-554e-458a-9851-059ccbe482a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:46.119961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad868-554e-458a-9851-059ccbe482a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:46.120092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad868-554e-458a-9851-059ccbe482a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:46.120388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad868-554e-458a-9851-059ccbe482a4 None admin] PATH_INFO: `/v3/projects/94006e699c6649098c687eb8363c07e2/users/a535c818476847f5bfe081a66a239331/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:46.122300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad868-554e-458a-9851-059ccbe482a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=94006e699c6649098c687eb8363c07e2, user_id=a535c818476847f5bfe081a66a239331, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:46.123707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad868-554e-458a-9851-059ccbe482a4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:46.220902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 640/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 08:02:45 2022] PUT /identity/v3/projects/94006e699c6649098c687eb8363c07e2/users/a535c818476847f5bfe081a66a239331/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:02:48.252937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a866a3-397e-41ba-9a25-8367a8e5c077 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:48.253470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a866a3-397e-41ba-9a25-8367a8e5c077 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:48.253652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a866a3-397e-41ba-9a25-8367a8e5c077 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:48.255099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 634/1274] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:48.260360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a297b2-075c-46be-8844-b3fa9d67377c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:48.260770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a297b2-075c-46be-8844-b3fa9d67377c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:48.260933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a297b2-075c-46be-8844-b3fa9d67377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:48.277792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-78a297b2-075c-46be-8844-b3fa9d67377c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:48.279010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-78a297b2-075c-46be-8844-b3fa9d67377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:48.349534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 641/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:48.373891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a866a3-397e-41ba-9a25-8367a8e5c077 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:48.491544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a866a3-397e-41ba-9a25-8367a8e5c077 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:48.513535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:48.537383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:48.538166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:48.538444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:48.538719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:48.551524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:02:48.563094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:48.564345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:48.565338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 635/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 08:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:48.571644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a297b2-075c-46be-8844-b3fa9d67377c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:48.657748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:48.675575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a297b2-075c-46be-8844-b3fa9d67377c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:48.714333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:48.715035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:48.715317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:48.715599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:48.716410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:48.716711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:48.718100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:48.727037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 642/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 08:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:48.733028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:48.838085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591f50-7803-44ce-b769-346978915c3e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:48.872028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:48.872886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:48.873174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:48.873452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:48.885478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:48.886948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:48.905056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:48.906451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:48.907411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:48.907411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:48.907411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:48.907411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:48.907411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 636/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:48.913361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:49.032628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799df80-c4fc-4e4d-8fe5-129063267879 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:49.076710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:49.077372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:49.077655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:49.077932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:49.078655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:49.078955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:49.080343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:49.092677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 643/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:49.098623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:49.129857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:49.197676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0597-a098-44fc-8244-80e5c7bf7166 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:49.231555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:49.232375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:49.232653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:49.232922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:49.241044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:49.242464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:02:49.257169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:49.258783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:49.259974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 637/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:02:49.264089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:49.267962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:49.365363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba21d-bd76-4a69-a52a-81868ce7691b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:49.399967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:49.400652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:49.400932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:49.401204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:49.402164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:49.402472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:49.403943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:49.421828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 644/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 08:02:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:49.428204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:49.516362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:49.525615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191548d-3581-4801-9ad8-ef5f6156c96c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:49.558836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:49.559477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:49.559764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:49.560044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:49.628040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:49.629490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:49.720495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:49.731382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 638/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 08:02:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:02:49.737168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:49.810321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:49.856966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbb651-ac77-48fa-b189-4edcf6f48ed3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:49.890295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:49.891035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:49.891319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:49.891591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:49.903270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:49.904746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:02:49.923252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:49.924492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:49.925775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:02:49.925775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:02:49.925775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:02:49.925775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:49.925775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 645/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:49.930378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:50.028721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882264a-07a9-49ea-8856-4df680e39f6a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:50.063192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:50.063852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:50.064138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:50.064448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:50.065167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:50.065501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:50.067530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:50.079671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 639/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 08:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:50.086042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:50.185214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b56c1-31ad-487f-9e5e-0460281587b4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:50.199492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:50.219279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:50.220129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:50.220438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:50.220711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:50.227258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:50.228783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:02:50.242477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:50.255000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jun 24 08:02:50.256169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 646/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 08:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:50.256869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:50.300897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:50.350306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23903c25-30ce-4459-8707-38d0df911c19 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:50.383145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c039e2-ea2e-44b5-81a4-c25390ce3b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:50.383834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c039e2-ea2e-44b5-81a4-c25390ce3b16 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:50.384119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c039e2-ea2e-44b5-81a4-c25390ce3b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:50.384434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c039e2-ea2e-44b5-81a4-c25390ce3b16 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:50.385219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c039e2-ea2e-44b5-81a4-c25390ce3b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:50.385531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c039e2-ea2e-44b5-81a4-c25390ce3b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:50.386959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c039e2-ea2e-44b5-81a4-c25390ce3b16 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:50.399418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 640/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 08:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:50.405909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:50.504906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55298b-a411-43f4-bd7d-3cdf6d9424b1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:50.538769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6b758-50e7-427b-a9b0-fd44c573935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:50.539521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b758-50e7-427b-a9b0-fd44c573935e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:50.539735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b758-50e7-427b-a9b0-fd44c573935e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:50.540004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b758-50e7-427b-a9b0-fd44c573935e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:50.541018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b758-50e7-427b-a9b0-fd44c573935e None admin] RBAC: Adding query filter params (role.id=278b998773bb4ec89978fcb835ceffc7, scope.project.id=94006e699c6649098c687eb8363c07e2, user.id=a535c818476847f5bfe081a66a239331) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:50.541329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b758-50e7-427b-a9b0-fd44c573935e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:50.542749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b758-50e7-427b-a9b0-fd44c573935e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:50.548536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 647/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 08:02:50 2022] GET /identity/v3/role_assignments?user.id=a535c818476847f5bfe081a66a239331&scope.project.id=94006e699c6649098c687eb8363c07e2&role.id=278b998773bb4ec89978fcb835ceffc7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:52.609863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eed0c9-7d92-4380-9b4f-076503a7429d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:52.610360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eed0c9-7d92-4380-9b4f-076503a7429d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:52.610486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eed0c9-7d92-4380-9b4f-076503a7429d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:52.611781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 641/1288] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:52.617571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d4d6-8905-43d6-ae75-745839591d34 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:52.618007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d4d6-8905-43d6-ae75-745839591d34 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:52.618135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d4d6-8905-43d6-ae75-745839591d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:52.635290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6b99d4d6-8905-43d6-ae75-745839591d34 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:52.636543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b99d4d6-8905-43d6-ae75-745839591d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:52.667408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:52.704260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 648/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:52.727910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eed0c9-7d92-4380-9b4f-076503a7429d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:52.835590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eed0c9-7d92-4380-9b4f-076503a7429d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:52.845865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:52.868626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:52.869414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:52.869700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:52.869980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:52.870632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:52.871993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:52.883497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:52.884813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:52.885883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 642/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 08:02:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:52.890789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99d4d6-8905-43d6-ae75-745839591d34 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:52.988894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99d4d6-8905-43d6-ae75-745839591d34 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:53.022957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90812e7-640b-4ebd-9a32-2ac7da86017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:53.023616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90812e7-640b-4ebd-9a32-2ac7da86017f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:53.023900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90812e7-640b-4ebd-9a32-2ac7da86017f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:53.024177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90812e7-640b-4ebd-9a32-2ac7da86017f None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:53.024915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90812e7-640b-4ebd-9a32-2ac7da86017f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:53.025222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90812e7-640b-4ebd-9a32-2ac7da86017f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:53.026580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90812e7-640b-4ebd-9a32-2ac7da86017f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:53.031596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 649/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 08:02:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:53.038710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:53.141187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f1e14-a4b3-4b8c-96ac-95d593ca5ae5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:53.174116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda0469-c93c-4ca9-adaf-66d634477a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:53.174825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda0469-c93c-4ca9-adaf-66d634477a84 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:53.175048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda0469-c93c-4ca9-adaf-66d634477a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:53.175346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda0469-c93c-4ca9-adaf-66d634477a84 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:53.176054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda0469-c93c-4ca9-adaf-66d634477a84 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:53.176378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda0469-c93c-4ca9-adaf-66d634477a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:53.177731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda0469-c93c-4ca9-adaf-66d634477a84 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:53.182066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 643/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 08:02:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:55.200077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3929854-2984-4baf-908e-a1460347ca3b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:55.200642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3929854-2984-4baf-908e-a1460347ca3b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:55.200733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3929854-2984-4baf-908e-a1460347ca3b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:55.202045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 650/1293] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:55.207773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1849fd-e261-4ebb-975d-5495a7147b18 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:55.215246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1849fd-e261-4ebb-975d-5495a7147b18 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:55.215246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1849fd-e261-4ebb-975d-5495a7147b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:55.225443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ae1849fd-e261-4ebb-975d-5495a7147b18 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:55.226630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ae1849fd-e261-4ebb-975d-5495a7147b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:55.255866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:55.293601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 644/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:02:55.316954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3929854-2984-4baf-908e-a1460347ca3b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:55.348309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:55.416406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3929854-2984-4baf-908e-a1460347ca3b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:55.449126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeaf05-e29f-4dc8-be15-e90d70b36843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:55.449778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeaf05-e29f-4dc8-be15-e90d70b36843 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:55.450059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeaf05-e29f-4dc8-be15-e90d70b36843 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:55.450384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeaf05-e29f-4dc8-be15-e90d70b36843 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:55.451067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeaf05-e29f-4dc8-be15-e90d70b36843 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:55.452471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeaf05-e29f-4dc8-be15-e90d70b36843 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:55.559332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 651/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 08:02:55 2022] POST /identity/v3/services => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:02:57.589495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce1291-a779-4ff0-b98b-da676e53b9e5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:57.589936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce1291-a779-4ff0-b98b-da676e53b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:57.590044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce1291-a779-4ff0-b98b-da676e53b9e5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:57.591401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 645/1296] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:02:57.596780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f231af1-1925-474f-b443-90a3431566ec None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:57.597776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f231af1-1925-474f-b443-90a3431566ec None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:57.597904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f231af1-1925-474f-b443-90a3431566ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:57.615463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9f231af1-1925-474f-b443-90a3431566ec None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:02:57.616713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9f231af1-1925-474f-b443-90a3431566ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:02:57.695950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 652/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:02:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:02:57.724586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce1291-a779-4ff0-b98b-da676e53b9e5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:57.824780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce1291-a779-4ff0-b98b-da676e53b9e5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:57.858858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:57.859577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:57.859862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:57.860140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:57.860821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:57.862196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:02:57.874608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:02:57.875792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:02:57.876836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 646/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 08:02:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:02:57.881836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f231af1-1925-474f-b443-90a3431566ec None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:57.899927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:57.978833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f231af1-1925-474f-b443-90a3431566ec None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:58.012564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81adef-81bb-4459-a873-72396439beec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:58.013215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81adef-81bb-4459-a873-72396439beec None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:58.013496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81adef-81bb-4459-a873-72396439beec None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:58.013769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81adef-81bb-4459-a873-72396439beec None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:58.014479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81adef-81bb-4459-a873-72396439beec None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:58.014987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81adef-81bb-4459-a873-72396439beec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:58.016649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81adef-81bb-4459-a873-72396439beec None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:58.023432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 653/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 08:02:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:58.029623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:58.061637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:58.128604 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00c9a1-5d69-4bfb-8148-69bb3c2c7f96 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:58.164058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942430ec-c652-4f75-9920-bdb00bcec684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:58.164741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942430ec-c652-4f75-9920-bdb00bcec684 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:58.165027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942430ec-c652-4f75-9920-bdb00bcec684 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:58.165303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942430ec-c652-4f75-9920-bdb00bcec684 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:58.166121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942430ec-c652-4f75-9920-bdb00bcec684 None admin] RBAC: Adding query filter params (interface=public, service_id=49bf5a1146a64a068af58cce9ca54940, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:02:58.166432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942430ec-c652-4f75-9920-bdb00bcec684 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:58.167793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942430ec-c652-4f75-9920-bdb00bcec684 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:58.172803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 647/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 08:02:58 2022] GET /identity/v3/endpoints?service_id=49bf5a1146a64a068af58cce9ca54940&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:02:58.178473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81adef-81bb-4459-a873-72396439beec None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:02:58.258051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:02:58.275089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81adef-81bb-4459-a873-72396439beec None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:02:58.309746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87873f62-614b-456f-83b2-5144821de856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:02:58.310408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873f62-614b-456f-83b2-5144821de856 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:02:58.310696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873f62-614b-456f-83b2-5144821de856 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:02:58.310976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873f62-614b-456f-83b2-5144821de856 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:02:58.311653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87873f62-614b-456f-83b2-5144821de856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:02:58.313042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87873f62-614b-456f-83b2-5144821de856 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:02:58.320475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 654/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 08:02:58 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:03:00.392460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0a40-632b-426d-b414-dc48990ea740 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:03:00.393090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0a40-632b-426d-b414-dc48990ea740 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:03:00.393090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0a40-632b-426d-b414-dc48990ea740 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:03:00.394589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 648/1302] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:03:00.399789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b30277-ce52-4469-a6ed-2664a9c44ab0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:03:00.400187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b30277-ce52-4469-a6ed-2664a9c44ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:03:00.400383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b30277-ce52-4469-a6ed-2664a9c44ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:03:00.417415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c6b30277-ce52-4469-a6ed-2664a9c44ab0 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:03:00.418575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c6b30277-ce52-4469-a6ed-2664a9c44ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:03:00.484064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 655/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:03:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:03:00.508120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab0a40-632b-426d-b414-dc48990ea740 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:03:00.602849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:03:00.609500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab0a40-632b-426d-b414-dc48990ea740 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:03:00.642712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:03:00.643360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:03:00.643673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:03:00.643921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:03:00.644800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:03:00.646227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:03:00.658172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:03:00.659462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jun 24 08:03:00.661145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 649/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 08:03:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:03:00.666111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b30277-ce52-4469-a6ed-2664a9c44ab0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:03:00.743262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:03:00.765165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b30277-ce52-4469-a6ed-2664a9c44ab0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:03:00.798304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc12728-fd81-4062-bff7-bc79712c20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:03:00.799037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12728-fd81-4062-bff7-bc79712c20de None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:03:00.799324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12728-fd81-4062-bff7-bc79712c20de None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:03:00.799561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12728-fd81-4062-bff7-bc79712c20de None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:03:00.800374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc12728-fd81-4062-bff7-bc79712c20de None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:03:00.800937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc12728-fd81-4062-bff7-bc79712c20de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:03:00.802038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc12728-fd81-4062-bff7-bc79712c20de None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:03:00.807120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 656/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 08:03:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:03:00.813046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:03:00.912516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38da34-083f-4c0c-a51d-868384df9f6c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:03:00.945170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14e7af-7da2-4d9b-8676-715d020e8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:03:00.945811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e7af-7da2-4d9b-8676-715d020e8ce9 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:03:00.946094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e7af-7da2-4d9b-8676-715d020e8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:03:00.946367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e7af-7da2-4d9b-8676-715d020e8ce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:03:00.947101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14e7af-7da2-4d9b-8676-715d020e8ce9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:03:00.948479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14e7af-7da2-4d9b-8676-715d020e8ce9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:03:01.035318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 650/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 08:03:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:03:10.818287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=30 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:03:11.030326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:09:55.918940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09ad4-5b21-4473-bc0a-3eda64b88b89 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:55.920111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09ad4-5b21-4473-bc0a-3eda64b88b89 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:55.920633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09ad4-5b21-4473-bc0a-3eda64b88b89 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:55.928780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001bbf-4199-481c-b9b7-62f042037b82 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:55.929721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001bbf-4199-481c-b9b7-62f042037b82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:55.930217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001bbf-4199-481c-b9b7-62f042037b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:55.933776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 657/1307] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:09:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:09:56.116435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-38001bbf-4199-481c-b9b7-62f042037b82 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:09:56.118096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-38001bbf-4199-481c-b9b7-62f042037b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:09:56.288231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 651/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:09:56.335254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd290b4-d854-40cb-9079-6b72e80df4b2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:56.335918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd290b4-d854-40cb-9079-6b72e80df4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:56.336301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd290b4-d854-40cb-9079-6b72e80df4b2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:56.337941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 658/1309] 10.222.0.42 () {54 vars in 964 bytes} [Fri Jun 24 08:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:09:56.344667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e55b4-4fa3-46b3-9f09-be4c70fda760 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:56.344947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e55b4-4fa3-46b3-9f09-be4c70fda760 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:56.345224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e55b4-4fa3-46b3-9f09-be4c70fda760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:56.425369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5f8e55b4-4fa3-46b3-9f09-be4c70fda760 None None] MFA Rules not processed for user `2d8183015eed4fd19e4a5fdf57d341e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:09:56.426473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f8e55b4-4fa3-46b3-9f09-be4c70fda760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:09:56.448287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:09:56.506485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 652/1310] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Jun 24 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:09:56.515300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd290b4-d854-40cb-9079-6b72e80df4b2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:09:56.517739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-edd290b4-d854-40cb-9079-6b72e80df4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:09:56.650691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd290b4-d854-40cb-9079-6b72e80df4b2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:09:56.732320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c06c1-6b38-40e6-800d-f61735e679e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:09:56.732896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c06c1-6b38-40e6-800d-f61735e679e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:56.733177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c06c1-6b38-40e6-800d-f61735e679e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:56.733456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c06c1-6b38-40e6-800d-f61735e679e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:56.735849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-df6c06c1-6b38-40e6-800d-f61735e679e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:09:56.796664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:09:56.864127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c06c1-6b38-40e6-800d-f61735e679e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:09:56.865668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c06c1-6b38-40e6-800d-f61735e679e9 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:09:56.888544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 659/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:09:59.283170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789d4d-c85b-4e21-941d-fb25b25e17c7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:59.283736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789d4d-c85b-4e21-941d-fb25b25e17c7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:59.283736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789d4d-c85b-4e21-941d-fb25b25e17c7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:59.285397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 653/1312] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:09:59.291347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430fd0-e020-4fe3-bcaa-aafda07af631 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:59.291858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430fd0-e020-4fe3-bcaa-aafda07af631 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:59.291953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430fd0-e020-4fe3-bcaa-aafda07af631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:59.374911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-26430fd0-e020-4fe3-bcaa-aafda07af631 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:09:59.376116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-26430fd0-e020-4fe3-bcaa-aafda07af631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:09:59.485985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 660/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:09:59.523768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789d4d-c85b-4e21-941d-fb25b25e17c7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:09:59.525381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1b789d4d-c85b-4e21-941d-fb25b25e17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:09:59.652430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789d4d-c85b-4e21-941d-fb25b25e17c7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:09:59.724905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:09:59.727513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a29e6d-ca95-400e-8047-d253129c1573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:09:59.728159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29e6d-ca95-400e-8047-d253129c1573 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:09:59.728470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29e6d-ca95-400e-8047-d253129c1573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:09:59.728744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29e6d-ca95-400e-8047-d253129c1573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:09:59.730385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-49a29e6d-ca95-400e-8047-d253129c1573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:09:59.842773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a29e6d-ca95-400e-8047-d253129c1573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:09:59.844134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a29e6d-ca95-400e-8047-d253129c1573 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:09:59.862396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 654/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:02.495435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47dd2-4b73-43fa-b30a-1e8bc013372b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:02.495974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47dd2-4b73-43fa-b30a-1e8bc013372b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:02.495974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47dd2-4b73-43fa-b30a-1e8bc013372b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:02.497426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 661/1315] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:02.503135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353e9c-f96c-407d-b66d-cca79a3ac088 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:02.503543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353e9c-f96c-407d-b66d-cca79a3ac088 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:02.503684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353e9c-f96c-407d-b66d-cca79a3ac088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:02.568600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dc353e9c-f96c-407d-b66d-cca79a3ac088 None None] MFA Rules not processed for user `f3095d000b9e4c71ac3c8d00210c3718`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:02.569796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc353e9c-f96c-407d-b66d-cca79a3ac088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:02.621347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:02.666253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 655/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:10:02.706735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47dd2-4b73-43fa-b30a-1e8bc013372b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:02.708291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-35a47dd2-4b73-43fa-b30a-1e8bc013372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:02.717954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:02.810576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47dd2-4b73-43fa-b30a-1e8bc013372b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:02.883846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f93cd-677d-4e99-b490-3a8404070fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:02.884509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f93cd-677d-4e99-b490-3a8404070fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:02.884792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f93cd-677d-4e99-b490-3a8404070fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:02.885069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f93cd-677d-4e99-b490-3a8404070fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:02.886680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ea8f93cd-677d-4e99-b490-3a8404070fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:02.947349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:02.992733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f93cd-677d-4e99-b490-3a8404070fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:02.994163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f93cd-677d-4e99-b490-3a8404070fb8 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:03.012610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 662/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:05.812810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ed40-53e2-4bac-847c-d8da7e785ceb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:05.813346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ed40-53e2-4bac-847c-d8da7e785ceb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:05.813472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ed40-53e2-4bac-847c-d8da7e785ceb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:05.814829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 656/1318] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:05.820103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ec91-5052-4cc1-bb55-aece0fb66f9e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:05.820523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ec91-5052-4cc1-bb55-aece0fb66f9e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:05.820697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ec91-5052-4cc1-bb55-aece0fb66f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:05.884911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6820ec91-5052-4cc1-bb55-aece0fb66f9e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:05.886112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6820ec91-5052-4cc1-bb55-aece0fb66f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:05.982008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 663/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:06.020758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ed40-53e2-4bac-847c-d8da7e785ceb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:06.022473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3354ed40-53e2-4bac-847c-d8da7e785ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:06.128012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ed40-53e2-4bac-847c-d8da7e785ceb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:06.199236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72192e6a-8ef6-4bc5-80a4-0952e0e9aabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:06.200522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72192e6a-8ef6-4bc5-80a4-0952e0e9aabb service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:06.200809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72192e6a-8ef6-4bc5-80a4-0952e0e9aabb service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:06.201087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72192e6a-8ef6-4bc5-80a4-0952e0e9aabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:06.202719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-72192e6a-8ef6-4bc5-80a4-0952e0e9aabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:06.210586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:06.309968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72192e6a-8ef6-4bc5-80a4-0952e0e9aabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:06.311400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72192e6a-8ef6-4bc5-80a4-0952e0e9aabb service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:06.329637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 657/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:09.385714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131113cb-03ee-4299-92b1-ee5523be8cb5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:09.386290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131113cb-03ee-4299-92b1-ee5523be8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:09.386290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131113cb-03ee-4299-92b1-ee5523be8cb5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:09.387650 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 664/1321] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:09.393452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955036e2-7b4d-43e8-9bca-5b5f65948696 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:09.393862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955036e2-7b4d-43e8-9bca-5b5f65948696 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:09.394014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955036e2-7b4d-43e8-9bca-5b5f65948696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:09.459540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-955036e2-7b4d-43e8-9bca-5b5f65948696 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:09.460825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-955036e2-7b4d-43e8-9bca-5b5f65948696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:09.519272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:09.558053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 658/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:09.597039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131113cb-03ee-4299-92b1-ee5523be8cb5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:09.598629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-131113cb-03ee-4299-92b1-ee5523be8cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:09.620772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:09.715101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131113cb-03ee-4299-92b1-ee5523be8cb5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:09.792854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebdf9c-af06-421a-aeae-821aa2127e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:09.793518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebdf9c-af06-421a-aeae-821aa2127e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:09.793804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebdf9c-af06-421a-aeae-821aa2127e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:09.794087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebdf9c-af06-421a-aeae-821aa2127e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:09.795831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-89ebdf9c-af06-421a-aeae-821aa2127e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:09.869299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:09.908929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebdf9c-af06-421a-aeae-821aa2127e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:09.910367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebdf9c-af06-421a-aeae-821aa2127e0a service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:09.928986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 665/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:12.053858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1ddf-586e-4b56-8e4b-1e5a683705cd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:12.054503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1ddf-586e-4b56-8e4b-1e5a683705cd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:12.054649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1ddf-586e-4b56-8e4b-1e5a683705cd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:12.056060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 659/1324] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:12.061420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eea5f-4d30-4975-b396-5f64f1b6cf29 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:12.061890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eea5f-4d30-4975-b396-5f64f1b6cf29 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:12.062128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eea5f-4d30-4975-b396-5f64f1b6cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:12.127881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e61eea5f-4d30-4975-b396-5f64f1b6cf29 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:12.129019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e61eea5f-4d30-4975-b396-5f64f1b6cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:12.227501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 666/1325] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:12.262998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b1ddf-586e-4b56-8e4b-1e5a683705cd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:12.264559 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-190b1ddf-586e-4b56-8e4b-1e5a683705cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:12.367693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b1ddf-586e-4b56-8e4b-1e5a683705cd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:12.441606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139579f-4030-4528-8cf1-083b37b028c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:12.442257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139579f-4030-4528-8cf1-083b37b028c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:12.442539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139579f-4030-4528-8cf1-083b37b028c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:12.442813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139579f-4030-4528-8cf1-083b37b028c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:12.444487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a139579f-4030-4528-8cf1-083b37b028c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:12.461295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:12.559757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139579f-4030-4528-8cf1-083b37b028c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:12.561222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139579f-4030-4528-8cf1-083b37b028c4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:12.581191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 660/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:14.678563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fe73-d548-4099-82ee-d18cc9ae2e3f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:14.679143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fe73-d548-4099-82ee-d18cc9ae2e3f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:14.679143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fe73-d548-4099-82ee-d18cc9ae2e3f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:14.680596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 667/1327] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:14.686498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ffb2-82a3-47e9-9ed0-cd5123014093 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:14.687048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ffb2-82a3-47e9-9ed0-cd5123014093 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:14.687048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ffb2-82a3-47e9-9ed0-cd5123014093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:14.752617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a995ffb2-82a3-47e9-9ed0-cd5123014093 None None] MFA Rules not processed for user `f3095d000b9e4c71ac3c8d00210c3718`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:14.753811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a995ffb2-82a3-47e9-9ed0-cd5123014093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:14.817741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:14.856310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 661/1328] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:14.890420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511fe73-d548-4099-82ee-d18cc9ae2e3f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:14.892680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4511fe73-d548-4099-82ee-d18cc9ae2e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:14.924764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:15.002449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511fe73-d548-4099-82ee-d18cc9ae2e3f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:15.075115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6800d89-2e4c-49f7-8de1-f7e6953b2594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:15.075746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800d89-2e4c-49f7-8de1-f7e6953b2594 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:15.076023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800d89-2e4c-49f7-8de1-f7e6953b2594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:15.076324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800d89-2e4c-49f7-8de1-f7e6953b2594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:15.078504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6800d89-2e4c-49f7-8de1-f7e6953b2594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:15.157315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:15.190676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6800d89-2e4c-49f7-8de1-f7e6953b2594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:15.192134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6800d89-2e4c-49f7-8de1-f7e6953b2594 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:15.210714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 668/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:17.677916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199feab5-3caf-4dba-b4b1-ec58914ceee9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:17.678380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199feab5-3caf-4dba-b4b1-ec58914ceee9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:17.678489 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199feab5-3caf-4dba-b4b1-ec58914ceee9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:17.679910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 662/1330] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:17.685413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c1d0-d3ee-4b0d-bac9-85b8bbf6b637 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:17.685854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c1d0-d3ee-4b0d-bac9-85b8bbf6b637 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:17.686050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c1d0-d3ee-4b0d-bac9-85b8bbf6b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:17.753801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a953c1d0-d3ee-4b0d-bac9-85b8bbf6b637 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:17.755023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a953c1d0-d3ee-4b0d-bac9-85b8bbf6b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:17.851757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 669/1331] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:17.887076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199feab5-3caf-4dba-b4b1-ec58914ceee9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:17.888636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-199feab5-3caf-4dba-b4b1-ec58914ceee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:17.991456 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199feab5-3caf-4dba-b4b1-ec58914ceee9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:18.063117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699a305-1997-4db8-872a-1ef428c6409f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:18.063749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a305-1997-4db8-872a-1ef428c6409f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:18.064030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a305-1997-4db8-872a-1ef428c6409f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:18.064335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a305-1997-4db8-872a-1ef428c6409f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:18.065948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6699a305-1997-4db8-872a-1ef428c6409f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:18.091972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:18.176276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699a305-1997-4db8-872a-1ef428c6409f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:18.177670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699a305-1997-4db8-872a-1ef428c6409f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:18.195297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 663/1332] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:20.262619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3693-2eac-45ab-807c-67067586d3c5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:20.263185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3693-2eac-45ab-807c-67067586d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:20.263185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3693-2eac-45ab-807c-67067586d3c5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:20.264581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 670/1333] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:20.270310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7bd7-a47a-4b70-86d4-e124bcd99bcd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:20.270753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7bd7-a47a-4b70-86d4-e124bcd99bcd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:20.270871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7bd7-a47a-4b70-86d4-e124bcd99bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:20.334411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-717d7bd7-a47a-4b70-86d4-e124bcd99bcd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:20.335603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-717d7bd7-a47a-4b70-86d4-e124bcd99bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:20.409073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:20.431206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 664/1334] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:20.487163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f812a-ef32-43fb-bdec-f2ca9d9592f8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:20.487458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f812a-ef32-43fb-bdec-f2ca9d9592f8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:20.487738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f812a-ef32-43fb-bdec-f2ca9d9592f8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:20.489153 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 671/1335] 10.222.0.42 () {54 vars in 964 bytes} [Fri Jun 24 08:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:20.495148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e703b-f967-44b5-a26a-47eabd0e2b90 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:20.495439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e703b-f967-44b5-a26a-47eabd0e2b90 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:20.495723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e703b-f967-44b5-a26a-47eabd0e2b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:20.571346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-053e703b-f967-44b5-a26a-47eabd0e2b90 None None] MFA Rules not processed for user `2d8183015eed4fd19e4a5fdf57d341e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:20.572503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-053e703b-f967-44b5-a26a-47eabd0e2b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:20.648284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 665/1336] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Jun 24 08:10:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:20.658235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f812a-ef32-43fb-bdec-f2ca9d9592f8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:20.659732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fb3f812a-ef32-43fb-bdec-f2ca9d9592f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:20.698542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:20.760527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f812a-ef32-43fb-bdec-f2ca9d9592f8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:20.833977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ac200-d705-40b1-8e73-d18a987e929c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:20.834546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac200-d705-40b1-8e73-d18a987e929c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:20.834831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac200-d705-40b1-8e73-d18a987e929c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:20.835111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac200-d705-40b1-8e73-d18a987e929c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:20.836763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2d0ac200-d705-40b1-8e73-d18a987e929c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:20.926587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:20.952084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac200-d705-40b1-8e73-d18a987e929c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:20.954400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac200-d705-40b1-8e73-d18a987e929c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:20.972880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 672/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:24.172565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154731e-b549-4b89-a68e-8939b4b716f0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:24.173104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154731e-b549-4b89-a68e-8939b4b716f0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:24.173104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154731e-b549-4b89-a68e-8939b4b716f0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:24.174531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 666/1338] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:24.179670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0de2-28b5-4cd6-9878-2cf5658b9f85 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:24.180095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0de2-28b5-4cd6-9878-2cf5658b9f85 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:24.180249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b0de2-28b5-4cd6-9878-2cf5658b9f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:24.244865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-494b0de2-28b5-4cd6-9878-2cf5658b9f85 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:24.246046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-494b0de2-28b5-4cd6-9878-2cf5658b9f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:24.343047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 673/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:24.380832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154731e-b549-4b89-a68e-8939b4b716f0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:24.382345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4154731e-b549-4b89-a68e-8939b4b716f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:24.457914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:24.485920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154731e-b549-4b89-a68e-8939b4b716f0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:24.559414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281e56-4dff-4f7e-9097-59eb67752c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:24.560048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281e56-4dff-4f7e-9097-59eb67752c2c service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:24.560356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281e56-4dff-4f7e-9097-59eb67752c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:24.560631 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281e56-4dff-4f7e-9097-59eb67752c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:24.562386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-39281e56-4dff-4f7e-9097-59eb67752c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:24.670356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281e56-4dff-4f7e-9097-59eb67752c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:24.672364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281e56-4dff-4f7e-9097-59eb67752c2c service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:24.690503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 667/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:29.068248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3b6b-283e-4157-b3a7-0369a8f5e5a6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:29.068761 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3b6b-283e-4157-b3a7-0369a8f5e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:29.068854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3b6b-283e-4157-b3a7-0369a8f5e5a6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:29.070440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 674/1341] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:29.075694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95667ece-2521-44d1-8c19-0c5051945d14 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:29.076170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95667ece-2521-44d1-8c19-0c5051945d14 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:29.076313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95667ece-2521-44d1-8c19-0c5051945d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:29.083167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:29.151531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-95667ece-2521-44d1-8c19-0c5051945d14 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:29.152866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-95667ece-2521-44d1-8c19-0c5051945d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:29.271273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 668/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:29.309750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3b6b-283e-4157-b3a7-0369a8f5e5a6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:29.311914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-594a3b6b-283e-4157-b3a7-0369a8f5e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:29.362450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:29.408700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3b6b-283e-4157-b3a7-0369a8f5e5a6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:29.412508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc213-47fe-44a0-9ed6-612ab1a7789d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:29.413151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc213-47fe-44a0-9ed6-612ab1a7789d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:29.413435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc213-47fe-44a0-9ed6-612ab1a7789d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:29.413712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc213-47fe-44a0-9ed6-612ab1a7789d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:29.423646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc213-47fe-44a0-9ed6-612ab1a7789d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:29.425126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc213-47fe-44a0-9ed6-612ab1a7789d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:29.434514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 675/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:32.420607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257dd4-e290-4870-b8e2-411ecc982294 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:32.421181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257dd4-e290-4870-b8e2-411ecc982294 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:32.421181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257dd4-e290-4870-b8e2-411ecc982294 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:32.422548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 669/1344] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:32.428157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4415ce6-4dd5-4054-a279-48bc44b17a4b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:32.428666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4415ce6-4dd5-4054-a279-48bc44b17a4b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:32.428746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4415ce6-4dd5-4054-a279-48bc44b17a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:32.458702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f4415ce6-4dd5-4054-a279-48bc44b17a4b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:32.459928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f4415ce6-4dd5-4054-a279-48bc44b17a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:32.543200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 676/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:32.581547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257dd4-e290-4870-b8e2-411ecc982294 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:32.583441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27257dd4-e290-4870-b8e2-411ecc982294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:32.597558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257dd4-e290-4870-b8e2-411ecc982294 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:32.601224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04db6c1-373a-4984-aa62-3faeb501db0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:32.601866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db6c1-373a-4984-aa62-3faeb501db0b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:32.602150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db6c1-373a-4984-aa62-3faeb501db0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:32.602426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db6c1-373a-4984-aa62-3faeb501db0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:32.611698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db6c1-373a-4984-aa62-3faeb501db0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:32.613153 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db6c1-373a-4984-aa62-3faeb501db0b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:32.622590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 670/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:37.085405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44fc84-30c5-4c5b-8f3b-f94aaa373bad None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:37.085967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44fc84-30c5-4c5b-8f3b-f94aaa373bad None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:37.085967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44fc84-30c5-4c5b-8f3b-f94aaa373bad None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:37.087359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 677/1347] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:37.092659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce68f-73b4-4548-85ce-f105c994963f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:37.093063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce68f-73b4-4548-85ce-f105c994963f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:37.093215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce68f-73b4-4548-85ce-f105c994963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:37.111265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fddce68f-73b4-4548-85ce-f105c994963f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:37.112410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fddce68f-73b4-4548-85ce-f105c994963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:37.120420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 671/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:37.159037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44fc84-30c5-4c5b-8f3b-f94aaa373bad None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:37.169958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44fc84-30c5-4c5b-8f3b-f94aaa373bad None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:37.174237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaae163-fea9-470a-9da9-3d82de68a5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:37.174874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaae163-fea9-470a-9da9-3d82de68a5db service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:37.175154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaae163-fea9-470a-9da9-3d82de68a5db service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:37.175429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaae163-fea9-470a-9da9-3d82de68a5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:37.184507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaae163-fea9-470a-9da9-3d82de68a5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:37.185914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaae163-fea9-470a-9da9-3d82de68a5db service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:37.196821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 678/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:42.214278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96f3b-ca98-4f49-a698-57b13173cf7e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:42.214812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96f3b-ca98-4f49-a698-57b13173cf7e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:42.214812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96f3b-ca98-4f49-a698-57b13173cf7e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:42.219989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 672/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:10:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:42.231140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e004c-79a6-430a-9ca2-7494fe2da597 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:42.231604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e004c-79a6-430a-9ca2-7494fe2da597 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:42.231604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e004c-79a6-430a-9ca2-7494fe2da597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:42.315201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0e4e004c-79a6-430a-9ca2-7494fe2da597 None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:42.316564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0e4e004c-79a6-430a-9ca2-7494fe2da597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:42.345588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:42.399681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 679/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:10:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:46.646118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1b7e-81eb-415a-865c-693815fb0d78 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:46.646639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1b7e-81eb-415a-865c-693815fb0d78 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:46.646639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1b7e-81eb-415a-865c-693815fb0d78 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:46.648030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 673/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:46.653365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011c18b-d0fe-4f2b-a68b-69da30b4b496 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:46.654208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011c18b-d0fe-4f2b-a68b-69da30b4b496 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:46.654717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011c18b-d0fe-4f2b-a68b-69da30b4b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:46.675066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3011c18b-d0fe-4f2b-a68b-69da30b4b496 None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:46.676675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3011c18b-d0fe-4f2b-a68b-69da30b4b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:46.688296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 680/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:47.108665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=72 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:10:48.172373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa611ab1-c0f0-4dd9-8864-f511aa35dde8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:48.173002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa611ab1-c0f0-4dd9-8864-f511aa35dde8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:48.173125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa611ab1-c0f0-4dd9-8864-f511aa35dde8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:48.174629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 674/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:48.180560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ede0c-bbcb-45b2-abf6-2c54f8095630 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:48.181025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ede0c-bbcb-45b2-abf6-2c54f8095630 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:48.181313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ede0c-bbcb-45b2-abf6-2c54f8095630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:48.201147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fc1ede0c-bbcb-45b2-abf6-2c54f8095630 None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:48.202414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fc1ede0c-bbcb-45b2-abf6-2c54f8095630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:48.211607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 681/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:10:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:51.884371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0b781-26f2-4e28-8962-a4d17472a08a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:51.884371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0b781-26f2-4e28-8962-a4d17472a08a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:51.884371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0b781-26f2-4e28-8962-a4d17472a08a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:51.884371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 675/1356] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:51.887757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6192-f376-4aeb-a83e-06815dbfab37 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:51.888297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6192-f376-4aeb-a83e-06815dbfab37 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:51.888385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6192-f376-4aeb-a83e-06815dbfab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:51.911465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-367e6192-f376-4aeb-a83e-06815dbfab37 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:51.914239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-367e6192-f376-4aeb-a83e-06815dbfab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:51.923994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 682/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:51.981329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7b383-1d3f-4ffe-8b36-2e65f60602eb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:51.981866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7b383-1d3f-4ffe-8b36-2e65f60602eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:51.982381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7b383-1d3f-4ffe-8b36-2e65f60602eb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:51.984426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 676/1358] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 08:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:51.997852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f672-5ebb-458b-ae88-d111377ea7bb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:51.998457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f672-5ebb-458b-ae88-d111377ea7bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:51.998945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f672-5ebb-458b-ae88-d111377ea7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:52.054589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-29a6f672-5ebb-458b-ae88-d111377ea7bb None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:52.055881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-29a6f672-5ebb-458b-ae88-d111377ea7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:52.144285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 683/1359] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 08:10:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:52.157315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7b383-1d3f-4ffe-8b36-2e65f60602eb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:52.172805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7b383-1d3f-4ffe-8b36-2e65f60602eb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:52.179163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174cd63-d342-4190-8cf6-c49ef9856915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:52.180048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174cd63-d342-4190-8cf6-c49ef9856915 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:52.180576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174cd63-d342-4190-8cf6-c49ef9856915 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:52.181096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174cd63-d342-4190-8cf6-c49ef9856915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:52.190411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174cd63-d342-4190-8cf6-c49ef9856915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:52.192498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174cd63-d342-4190-8cf6-c49ef9856915 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:52.204093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 677/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:54.484694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b42c5-1b68-40ef-9fb4-cd39103c1ef4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:54.485197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b42c5-1b68-40ef-9fb4-cd39103c1ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:54.485313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b42c5-1b68-40ef-9fb4-cd39103c1ef4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:54.486788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 684/1361] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:54.491822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94ce1e-5b2f-4a82-912a-2bb4b6d21ddf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:54.492347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94ce1e-5b2f-4a82-912a-2bb4b6d21ddf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:54.492439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94ce1e-5b2f-4a82-912a-2bb4b6d21ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:54.510391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ba94ce1e-5b2f-4a82-912a-2bb4b6d21ddf None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:54.511599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ba94ce1e-5b2f-4a82-912a-2bb4b6d21ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:54.520161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 678/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:54.565532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b42c5-1b68-40ef-9fb4-cd39103c1ef4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:54.586444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b42c5-1b68-40ef-9fb4-cd39103c1ef4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:54.592135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f697b6-0a9d-4782-a127-324c03784844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:54.592802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f697b6-0a9d-4782-a127-324c03784844 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:54.593098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f697b6-0a9d-4782-a127-324c03784844 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:54.593537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f697b6-0a9d-4782-a127-324c03784844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:54.602188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f697b6-0a9d-4782-a127-324c03784844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:54.603783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f697b6-0a9d-4782-a127-324c03784844 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:54.614121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 685/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:57.256146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fd4d1-e2f5-4a91-b86e-89b62d61d3fd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:57.256689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fd4d1-e2f5-4a91-b86e-89b62d61d3fd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:57.256689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fd4d1-e2f5-4a91-b86e-89b62d61d3fd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:57.258102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 679/1364] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:57.263549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb7364-d82a-4e55-8284-5babd76d4398 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:57.263966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb7364-d82a-4e55-8284-5babd76d4398 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:57.264104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb7364-d82a-4e55-8284-5babd76d4398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:57.281979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8fbb7364-d82a-4e55-8284-5babd76d4398 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:57.283169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8fbb7364-d82a-4e55-8284-5babd76d4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:57.291268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 686/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:10:57.338046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4e56f-4601-4dbb-8dea-c183d8c8c63e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:57.338332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4e56f-4601-4dbb-8dea-c183d8c8c63e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:57.338613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4e56f-4601-4dbb-8dea-c183d8c8c63e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:57.339985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 680/1366] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 08:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:57.346350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6bf1a-54dd-41cb-a7c6-64f116a916bb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:57.346640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6bf1a-54dd-41cb-a7c6-64f116a916bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:57.346924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6bf1a-54dd-41cb-a7c6-64f116a916bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:57.368624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fcd6bf1a-54dd-41cb-a7c6-64f116a916bb None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:57.369950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fcd6bf1a-54dd-41cb-a7c6-64f116a916bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:57.380499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 687/1367] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:57.388402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4e56f-4601-4dbb-8dea-c183d8c8c63e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:57.402854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4e56f-4601-4dbb-8dea-c183d8c8c63e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:57.408953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4653-8c2a-4bd1-bc06-559391017b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:57.409594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4653-8c2a-4bd1-bc06-559391017b57 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:57.409880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4653-8c2a-4bd1-bc06-559391017b57 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:57.410159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4653-8c2a-4bd1-bc06-559391017b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:57.418800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4653-8c2a-4bd1-bc06-559391017b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:57.420408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4653-8c2a-4bd1-bc06-559391017b57 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:57.430957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 681/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:10:59.711248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bc983-19a3-4624-9d2e-347092cf4525 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:59.711826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bc983-19a3-4624-9d2e-347092cf4525 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:59.712045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bc983-19a3-4624-9d2e-347092cf4525 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:59.713834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 688/1369] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:10:59.719150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ee7d-1e15-4d00-a789-33366553d761 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:59.719562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ee7d-1e15-4d00-a789-33366553d761 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:59.719713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ee7d-1e15-4d00-a789-33366553d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:59.738457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2b26ee7d-1e15-4d00-a789-33366553d761 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:10:59.739657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2b26ee7d-1e15-4d00-a789-33366553d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:10:59.747862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 682/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:10:59.792798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bc983-19a3-4624-9d2e-347092cf4525 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:10:59.807998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bc983-19a3-4624-9d2e-347092cf4525 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:10:59.814178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ccb7c-1bd3-4827-810c-703171e81ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:10:59.814823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ccb7c-1bd3-4827-810c-703171e81ee2 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:10:59.815108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ccb7c-1bd3-4827-810c-703171e81ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:10:59.815389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ccb7c-1bd3-4827-810c-703171e81ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:10:59.823825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ccb7c-1bd3-4827-810c-703171e81ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:10:59.825593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ccb7c-1bd3-4827-810c-703171e81ee2 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:10:59.836517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 689/1371] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:00.183975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40ae7-0704-4357-b3ac-df535106a2c5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:00.184187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40ae7-0704-4357-b3ac-df535106a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:00.184477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40ae7-0704-4357-b3ac-df535106a2c5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:00.185904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 683/1372] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:00.191774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a69ad4-dca2-4c86-9320-978fe43b5001 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:00.192318 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a69ad4-dca2-4c86-9320-978fe43b5001 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:00.192751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a69ad4-dca2-4c86-9320-978fe43b5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:00.212103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a2a69ad4-dca2-4c86-9320-978fe43b5001 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:00.213638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a2a69ad4-dca2-4c86-9320-978fe43b5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:00.224473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 690/1373] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:00.591926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032941b-15ba-4077-9bf8-d0fefea781bf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:00.592328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032941b-15ba-4077-9bf8-d0fefea781bf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:00.592678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032941b-15ba-4077-9bf8-d0fefea781bf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:00.594514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 684/1374] 10.222.0.42 () {54 vars in 963 bytes} [Fri Jun 24 08:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:00.599499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff818-aea2-4ff5-b882-b3c898439858 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:00.599874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff818-aea2-4ff5-b882-b3c898439858 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:00.600291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff818-aea2-4ff5-b882-b3c898439858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:00.607499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:11:00.655829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-efeff818-aea2-4ff5-b882-b3c898439858 None None] MFA Rules not processed for user `32681494192c4f6c9ba36d68e4b6399b`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:00.657847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-efeff818-aea2-4ff5-b882-b3c898439858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:00.724702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 691/1375] 10.222.0.42 () {58 vars in 1060 bytes} [Fri Jun 24 08:11:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:11:00.732953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032941b-15ba-4077-9bf8-d0fefea781bf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:00.746250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032941b-15ba-4077-9bf8-d0fefea781bf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:00.751360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5563-1861-4d2f-afcf-416a8f04c21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:00.752104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5563-1861-4d2f-afcf-416a8f04c21b service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:00.752515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5563-1861-4d2f-afcf-416a8f04c21b service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:00.752908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5563-1861-4d2f-afcf-416a8f04c21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:00.762871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5563-1861-4d2f-afcf-416a8f04c21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:00.764484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5563-1861-4d2f-afcf-416a8f04c21b service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:00.776041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 685/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:02.093907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f36c8-b9c6-4c0b-b404-2dd1ce686ce3 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:02.094456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f36c8-b9c6-4c0b-b404-2dd1ce686ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:02.094584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f36c8-b9c6-4c0b-b404-2dd1ce686ce3 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:02.095967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 692/1377] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:11:02.101262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdad6-b7b8-40ec-8c1a-72d9c2b3b663 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:02.101675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdad6-b7b8-40ec-8c1a-72d9c2b3b663 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:02.101814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdad6-b7b8-40ec-8c1a-72d9c2b3b663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:02.119646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-98bcdad6-b7b8-40ec-8c1a-72d9c2b3b663 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:02.120858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-98bcdad6-b7b8-40ec-8c1a-72d9c2b3b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:02.129243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 686/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:02.173281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f36c8-b9c6-4c0b-b404-2dd1ce686ce3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:02.188432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f36c8-b9c6-4c0b-b404-2dd1ce686ce3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:02.193939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e59e8d-37b7-41ac-b3b9-85f7860caa0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:02.194567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e59e8d-37b7-41ac-b3b9-85f7860caa0f service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:02.194845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e59e8d-37b7-41ac-b3b9-85f7860caa0f service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:02.195232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e59e8d-37b7-41ac-b3b9-85f7860caa0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:02.203938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e59e8d-37b7-41ac-b3b9-85f7860caa0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:02.205544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e59e8d-37b7-41ac-b3b9-85f7860caa0f service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:02.214767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 693/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:04.423611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7d79-40f1-4456-9d57-3df70abf2d72 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:04.424602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7d79-40f1-4456-9d57-3df70abf2d72 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:04.425175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7d79-40f1-4456-9d57-3df70abf2d72 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:04.427067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 687/1380] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:04.433243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417840-cbf4-48c6-b41f-cfd0b14d8a17 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:04.434193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417840-cbf4-48c6-b41f-cfd0b14d8a17 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:04.434695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417840-cbf4-48c6-b41f-cfd0b14d8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:04.461283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-72417840-cbf4-48c6-b41f-cfd0b14d8a17 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:04.462837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-72417840-cbf4-48c6-b41f-cfd0b14d8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:04.473427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 694/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:04.523733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7d79-40f1-4456-9d57-3df70abf2d72 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:04.541176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7d79-40f1-4456-9d57-3df70abf2d72 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:04.546862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496a615-c8cb-47aa-acf1-39942fbed66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:04.547518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a615-c8cb-47aa-acf1-39942fbed66b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:04.547785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a615-c8cb-47aa-acf1-39942fbed66b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:04.548307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a615-c8cb-47aa-acf1-39942fbed66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:04.556785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496a615-c8cb-47aa-acf1-39942fbed66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:04.558353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496a615-c8cb-47aa-acf1-39942fbed66b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:04.572133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 688/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:06.805090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76043-6a4c-480a-946e-4370d9261378 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:06.805664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76043-6a4c-480a-946e-4370d9261378 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:06.805664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76043-6a4c-480a-946e-4370d9261378 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:06.806992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 695/1383] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:06.812758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040962-2e8b-4576-a7e0-549a0f981741 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:06.813523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040962-2e8b-4576-a7e0-549a0f981741 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:06.813817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040962-2e8b-4576-a7e0-549a0f981741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:06.832739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9d040962-2e8b-4576-a7e0-549a0f981741 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:06.833990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d040962-2e8b-4576-a7e0-549a0f981741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:06.842501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 689/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:06.884528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf76043-6a4c-480a-946e-4370d9261378 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:06.899740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf76043-6a4c-480a-946e-4370d9261378 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:06.905424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ed40-7941-4a51-9b09-d4cff108f7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:06.906060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ed40-7941-4a51-9b09-d4cff108f7ec service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:06.906351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ed40-7941-4a51-9b09-d4cff108f7ec service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:06.906626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ed40-7941-4a51-9b09-d4cff108f7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:06.915126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ed40-7941-4a51-9b09-d4cff108f7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:06.916818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ed40-7941-4a51-9b09-d4cff108f7ec service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:06.927021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 696/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:08.990349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9566cd0-47b5-4cb0-a14c-8fe7875a79b3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:08.990896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9566cd0-47b5-4cb0-a14c-8fe7875a79b3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:08.990896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9566cd0-47b5-4cb0-a14c-8fe7875a79b3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:08.992365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 690/1386] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:08.997391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cebe-1e0c-4e89-bf59-80addeeb9faf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:08.997884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cebe-1e0c-4e89-bf59-80addeeb9faf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:08.997992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cebe-1e0c-4e89-bf59-80addeeb9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:09.017089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-aa47cebe-1e0c-4e89-bf59-80addeeb9faf None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:09.018762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aa47cebe-1e0c-4e89-bf59-80addeeb9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:09.029270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 697/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:09.078058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9566cd0-47b5-4cb0-a14c-8fe7875a79b3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:09.092840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9566cd0-47b5-4cb0-a14c-8fe7875a79b3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:09.098901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2aad2-810e-4e95-ba38-caea68d9350e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:09.099573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2aad2-810e-4e95-ba38-caea68d9350e service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:09.099811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2aad2-810e-4e95-ba38-caea68d9350e service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:09.100082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2aad2-810e-4e95-ba38-caea68d9350e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:09.108394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2aad2-810e-4e95-ba38-caea68d9350e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:09.110210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2aad2-810e-4e95-ba38-caea68d9350e service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:09.121055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 691/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:11.344673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3bbf5-0e46-4b01-9e23-fff27a8bcca4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:11.345243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3bbf5-0e46-4b01-9e23-fff27a8bcca4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:11.345243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3bbf5-0e46-4b01-9e23-fff27a8bcca4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:11.346710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 698/1389] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:11.352593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889df25-c753-4791-93b8-615173615ab8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:11.353009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889df25-c753-4791-93b8-615173615ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:11.353329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889df25-c753-4791-93b8-615173615ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:11.376696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4889df25-c753-4791-93b8-615173615ab8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:11.377910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4889df25-c753-4791-93b8-615173615ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:11.385828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 692/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:11.436250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3bbf5-0e46-4b01-9e23-fff27a8bcca4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:11.450611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3bbf5-0e46-4b01-9e23-fff27a8bcca4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:11.456855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5897-b997-42ca-9ebb-2e9098cfa31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:11.457520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5897-b997-42ca-9ebb-2e9098cfa31d service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:11.457804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5897-b997-42ca-9ebb-2e9098cfa31d service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:11.458081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5897-b997-42ca-9ebb-2e9098cfa31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:11.466398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf5897-b997-42ca-9ebb-2e9098cfa31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:11.467976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf5897-b997-42ca-9ebb-2e9098cfa31d service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:11.478182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 699/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:13.741609 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3ab0-e152-4210-9459-729f73a945bb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:13.742199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3ab0-e152-4210-9459-729f73a945bb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:13.742331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3ab0-e152-4210-9459-729f73a945bb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:13.743636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 693/1392] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:13.750157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3cebd-3bdf-42e2-bf89-e7ac0ecbe390 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:13.750730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3cebd-3bdf-42e2-bf89-e7ac0ecbe390 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:13.750730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3cebd-3bdf-42e2-bf89-e7ac0ecbe390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:13.769007 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-93f3cebd-3bdf-42e2-bf89-e7ac0ecbe390 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:13.770214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-93f3cebd-3bdf-42e2-bf89-e7ac0ecbe390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:13.778018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 700/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:13.822139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe3ab0-e152-4210-9459-729f73a945bb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:13.837636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe3ab0-e152-4210-9459-729f73a945bb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:13.843944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c1cb-4780-457f-9c9f-adb286264ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:13.850070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c1cb-4780-457f-9c9f-adb286264ee3 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:13.850070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c1cb-4780-457f-9c9f-adb286264ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:13.850070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c1cb-4780-457f-9c9f-adb286264ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:13.853662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c1cb-4780-457f-9c9f-adb286264ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:13.855248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c1cb-4780-457f-9c9f-adb286264ee3 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:13.865002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 694/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:16.150101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11943d-dfc2-4e8f-8730-8d47ff4b91c9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:16.150676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11943d-dfc2-4e8f-8730-8d47ff4b91c9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:16.150676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11943d-dfc2-4e8f-8730-8d47ff4b91c9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:16.152105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 701/1395] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:16.158066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff04e-7f56-4a53-a3b5-af7c9e655f15 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:16.158507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff04e-7f56-4a53-a3b5-af7c9e655f15 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:16.158621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff04e-7f56-4a53-a3b5-af7c9e655f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:16.176756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-77dff04e-7f56-4a53-a3b5-af7c9e655f15 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:16.177934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-77dff04e-7f56-4a53-a3b5-af7c9e655f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:16.185753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 695/1396] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:11:16.230609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11943d-dfc2-4e8f-8730-8d47ff4b91c9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:16.245294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11943d-dfc2-4e8f-8730-8d47ff4b91c9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:16.250922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f40096-dda4-462d-8fbc-33de32918932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:16.251564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40096-dda4-462d-8fbc-33de32918932 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:16.251849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40096-dda4-462d-8fbc-33de32918932 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:16.252125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40096-dda4-462d-8fbc-33de32918932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:16.260611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f40096-dda4-462d-8fbc-33de32918932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:16.262189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f40096-dda4-462d-8fbc-33de32918932 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:16.272251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 702/1397] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:16.769679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703abcf-c48e-417f-867c-d1b8da863005 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:16.769971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703abcf-c48e-417f-867c-d1b8da863005 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:16.770252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703abcf-c48e-417f-867c-d1b8da863005 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:16.771681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 696/1398] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:16.777031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195590d-8080-4af6-bcf1-a8d7e3e4db40 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:16.777320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195590d-8080-4af6-bcf1-a8d7e3e4db40 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:16.777596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195590d-8080-4af6-bcf1-a8d7e3e4db40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:16.796969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f195590d-8080-4af6-bcf1-a8d7e3e4db40 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:16.798304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f195590d-8080-4af6-bcf1-a8d7e3e4db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:16.806030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 703/1399] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:16.863725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2431d-67e1-476e-a8b7-a48e62a7e8e7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:16.864010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2431d-67e1-476e-a8b7-a48e62a7e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:16.864328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2431d-67e1-476e-a8b7-a48e62a7e8e7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:16.865705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 697/1400] 10.222.0.42 () {54 vars in 962 bytes} [Fri Jun 24 08:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:16.870968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd7ad-e059-4233-bc3a-91fe1a871f46 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:16.871338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd7ad-e059-4233-bc3a-91fe1a871f46 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:16.871685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd7ad-e059-4233-bc3a-91fe1a871f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:16.921890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b4cfd7ad-e059-4233-bc3a-91fe1a871f46 None None] MFA Rules not processed for user `d61999e7673a4a1cbc5ad487f8d16845`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:16.923078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b4cfd7ad-e059-4233-bc3a-91fe1a871f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:16.956175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:11:16.984871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 704/1401] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Jun 24 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:16.992790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2431d-67e1-476e-a8b7-a48e62a7e8e7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:17.006616 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2431d-67e1-476e-a8b7-a48e62a7e8e7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:17.013169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101b0c8-7bf7-4808-a210-2b0b38e15457 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:17.013871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b0c8-7bf7-4808-a210-2b0b38e15457 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:17.014219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b0c8-7bf7-4808-a210-2b0b38e15457 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:17.014564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b0c8-7bf7-4808-a210-2b0b38e15457 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:17.024788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101b0c8-7bf7-4808-a210-2b0b38e15457 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:17.026148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101b0c8-7bf7-4808-a210-2b0b38e15457 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:17.037505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 698/1402] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:11:18.029602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92194bd2-da22-43d4-a2ca-70afff664baf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:18.030104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92194bd2-da22-43d4-a2ca-70afff664baf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:18.030205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92194bd2-da22-43d4-a2ca-70afff664baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:18.079390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-92194bd2-da22-43d4-a2ca-70afff664baf None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:18.080668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-92194bd2-da22-43d4-a2ca-70afff664baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:18.148328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 705/1403] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:18.191143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51987c10-0f9d-4436-a8c9-ca332fc7b3aa None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:18.191660 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51987c10-0f9d-4436-a8c9-ca332fc7b3aa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:18.191768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51987c10-0f9d-4436-a8c9-ca332fc7b3aa None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:18.193118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 699/1404] 10.222.0.42 () {54 vars in 942 bytes} [Fri Jun 24 08:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:18.199412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24cf1-ae2e-4e7b-9914-7831502dd999 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:18.199714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24cf1-ae2e-4e7b-9914-7831502dd999 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:18.199978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24cf1-ae2e-4e7b-9914-7831502dd999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:18.250333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fbc24cf1-ae2e-4e7b-9914-7831502dd999 None None] MFA Rules not processed for user `7277ec365bac4e9d8a22f63c55bbb908`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:18.251537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fbc24cf1-ae2e-4e7b-9914-7831502dd999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:18.325315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 706/1405] 10.222.0.42 () {58 vars in 1039 bytes} [Fri Jun 24 08:11:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:11:18.335314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51987c10-0f9d-4436-a8c9-ca332fc7b3aa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:18.342799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=61 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:11:18.350215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51987c10-0f9d-4436-a8c9-ca332fc7b3aa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:18.355138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f99da3-0f55-41bb-90ce-d6e8420ec3c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:18.355795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f99da3-0f55-41bb-90ce-d6e8420ec3c7 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:18.356076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f99da3-0f55-41bb-90ce-d6e8420ec3c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:18.356373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f99da3-0f55-41bb-90ce-d6e8420ec3c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:18.365044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f99da3-0f55-41bb-90ce-d6e8420ec3c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:18.366605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f99da3-0f55-41bb-90ce-d6e8420ec3c7 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:18.374931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 700/1406] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:11:18.454434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088744-38ad-4090-9c1f-9c06f6192f81 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:18.454721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088744-38ad-4090-9c1f-9c06f6192f81 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:18.454996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088744-38ad-4090-9c1f-9c06f6192f81 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:18.456420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 707/1407] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:18.461807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d2af-ea20-4d46-ae93-716763b3f7cf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:18.462103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d2af-ea20-4d46-ae93-716763b3f7cf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:18.462390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d2af-ea20-4d46-ae93-716763b3f7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:18.480921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4309d2af-ea20-4d46-ae93-716763b3f7cf None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:18.482120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4309d2af-ea20-4d46-ae93-716763b3f7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:18.490379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 701/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:18.535087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5088744-38ad-4090-9c1f-9c06f6192f81 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:18.549513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5088744-38ad-4090-9c1f-9c06f6192f81 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:18.554902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276307ad-71b0-48e2-b545-9b674b1c957a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:18.555532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276307ad-71b0-48e2-b545-9b674b1c957a service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:18.555820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276307ad-71b0-48e2-b545-9b674b1c957a service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:18.556093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276307ad-71b0-48e2-b545-9b674b1c957a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:18.564741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276307ad-71b0-48e2-b545-9b674b1c957a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:18.566336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276307ad-71b0-48e2-b545-9b674b1c957a service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:18.571411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:11:18.576414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 708/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:11:28.475744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:11:41.936007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c20e46-6a6c-4603-bb22-2bfa303927f2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:41.936657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c20e46-6a6c-4603-bb22-2bfa303927f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:41.936657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c20e46-6a6c-4603-bb22-2bfa303927f2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:41.938636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 702/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri Jun 24 08:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:41.943630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c178e9-07d8-4052-a800-ffa708489504 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:41.944050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c178e9-07d8-4052-a800-ffa708489504 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:41.944272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c178e9-07d8-4052-a800-ffa708489504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:41.962164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-04c178e9-07d8-4052-a800-ffa708489504 None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:41.963363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-04c178e9-07d8-4052-a800-ffa708489504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:41.972187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 709/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Jun 24 08:11:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:41.987010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e021-9e6b-4b45-8f6f-fb3b9c99c4bc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:41.987300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e021-9e6b-4b45-8f6f-fb3b9c99c4bc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:41.987605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e021-9e6b-4b45-8f6f-fb3b9c99c4bc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:41.988974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 703/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri Jun 24 08:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:41.993371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a399d-e3a4-48d1-b9cf-450a7f0e702e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:41.993661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a399d-e3a4-48d1-b9cf-450a7f0e702e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:41.993942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a399d-e3a4-48d1-b9cf-450a7f0e702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:42.012120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bc9a399d-e3a4-48d1-b9cf-450a7f0e702e None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:42.013355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bc9a399d-e3a4-48d1-b9cf-450a7f0e702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:42.022653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 710/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Jun 24 08:11:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:44.537113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e0a1-a98f-4559-b5bd-20008751d858 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:44.537682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e0a1-a98f-4559-b5bd-20008751d858 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:44.537682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e0a1-a98f-4559-b5bd-20008751d858 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:44.539268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:44.544457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39061b8c-ed5f-4101-89da-9ea806ce018d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:44.544865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39061b8c-ed5f-4101-89da-9ea806ce018d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:44.545015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39061b8c-ed5f-4101-89da-9ea806ce018d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:44.564216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-39061b8c-ed5f-4101-89da-9ea806ce018d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:44.565427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-39061b8c-ed5f-4101-89da-9ea806ce018d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:44.573272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:44.616214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e0a1-a98f-4559-b5bd-20008751d858 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:44.630831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e0a1-a98f-4559-b5bd-20008751d858 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:44.636290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74cf9a-a533-4838-8a81-199fe232d9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:44.636917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74cf9a-a533-4838-8a81-199fe232d9a2 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:44.637203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74cf9a-a533-4838-8a81-199fe232d9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:44.637478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74cf9a-a533-4838-8a81-199fe232d9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:44.646459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74cf9a-a533-4838-8a81-199fe232d9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:44.648009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74cf9a-a533-4838-8a81-199fe232d9a2 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:44.657739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 705/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:45.555943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c86544-6c6a-4526-8879-00801eabee49 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:45.556527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c86544-6c6a-4526-8879-00801eabee49 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:45.556527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c86544-6c6a-4526-8879-00801eabee49 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:45.557886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:45.563373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3a910-aef3-4cc0-9925-19847189566f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:45.563811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3a910-aef3-4cc0-9925-19847189566f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:45.563931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3a910-aef3-4cc0-9925-19847189566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:45.582716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-97d3a910-aef3-4cc0-9925-19847189566f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:45.583910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97d3a910-aef3-4cc0-9925-19847189566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:45.591675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:45.745129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c86544-6c6a-4526-8879-00801eabee49 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:45.759954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c86544-6c6a-4526-8879-00801eabee49 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:45.765306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1e337-37b2-4a7e-adf0-135209adc6f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:45.766108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e337-37b2-4a7e-adf0-135209adc6f0 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:45.766391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e337-37b2-4a7e-adf0-135209adc6f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:45.766665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e337-37b2-4a7e-adf0-135209adc6f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:45.774652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1e337-37b2-4a7e-adf0-135209adc6f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:45.776227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1e337-37b2-4a7e-adf0-135209adc6f0 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:45.785763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 713/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:46.680899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58472d9-0d8e-4e20-987d-fc475aaf6ae7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:46.681460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58472d9-0d8e-4e20-987d-fc475aaf6ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:46.681560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58472d9-0d8e-4e20-987d-fc475aaf6ae7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:46.682900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:46.688561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3924a-ab70-4f6d-867c-49c7a1745189 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:46.688953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3924a-ab70-4f6d-867c-49c7a1745189 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:46.689118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3924a-ab70-4f6d-867c-49c7a1745189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:46.707411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-90d3924a-ab70-4f6d-867c-49c7a1745189 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:46.708640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-90d3924a-ab70-4f6d-867c-49c7a1745189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:46.716566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:46.867426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58472d9-0d8e-4e20-987d-fc475aaf6ae7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:46.882094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58472d9-0d8e-4e20-987d-fc475aaf6ae7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:46.887857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb16f4-a140-4014-8477-53ee5074a6cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:46.888519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb16f4-a140-4014-8477-53ee5074a6cc service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:46.888806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb16f4-a140-4014-8477-53ee5074a6cc service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:46.889084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb16f4-a140-4014-8477-53ee5074a6cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:46.897924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb16f4-a140-4014-8477-53ee5074a6cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:46.899525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb16f4-a140-4014-8477-53ee5074a6cc service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:46.908759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 708/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:47.778530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956c98b-b675-4064-80f8-aa1205ce13dd None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:47.779061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956c98b-b675-4064-80f8-aa1205ce13dd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:47.779061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956c98b-b675-4064-80f8-aa1205ce13dd None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:47.780468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:47.785971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce95ef-d6e4-4bd4-adef-c8abd838ae23 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:47.786379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce95ef-d6e4-4bd4-adef-c8abd838ae23 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:47.786535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce95ef-d6e4-4bd4-adef-c8abd838ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:47.805368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7fce95ef-d6e4-4bd4-adef-c8abd838ae23 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:47.806539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7fce95ef-d6e4-4bd4-adef-c8abd838ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:47.814271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:47.964335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956c98b-b675-4064-80f8-aa1205ce13dd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:47.979010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956c98b-b675-4064-80f8-aa1205ce13dd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:47.984427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c36d-7edb-4836-b705-0fa2506fd32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:47.985047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c36d-7edb-4836-b705-0fa2506fd32a service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:47.985327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c36d-7edb-4836-b705-0fa2506fd32a service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:47.985601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c36d-7edb-4836-b705-0fa2506fd32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:47.993650 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c36d-7edb-4836-b705-0fa2506fd32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:47.995211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c36d-7edb-4836-b705-0fa2506fd32a service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:48.004534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 716/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:48.858116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f39bc-6817-40ea-b902-0a9f09059bfe None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:48.858645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f39bc-6817-40ea-b902-0a9f09059bfe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:48.858645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f39bc-6817-40ea-b902-0a9f09059bfe None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:48.860779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:48.865724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55417-1ab2-47c8-8c9f-cfd82b9d517f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:48.866137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55417-1ab2-47c8-8c9f-cfd82b9d517f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:48.866286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55417-1ab2-47c8-8c9f-cfd82b9d517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:48.884675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b3c55417-1ab2-47c8-8c9f-cfd82b9d517f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:48.885855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b3c55417-1ab2-47c8-8c9f-cfd82b9d517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:48.893872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:49.046789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f39bc-6817-40ea-b902-0a9f09059bfe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:49.061331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f39bc-6817-40ea-b902-0a9f09059bfe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:49.066707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ebbb6-ccdb-4605-b8f2-acfeecd52fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:49.067328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebbb6-ccdb-4605-b8f2-acfeecd52fa4 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:49.067607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebbb6-ccdb-4605-b8f2-acfeecd52fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:49.067881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebbb6-ccdb-4605-b8f2-acfeecd52fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:49.075803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ebbb6-ccdb-4605-b8f2-acfeecd52fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:49.077401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ebbb6-ccdb-4605-b8f2-acfeecd52fa4 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:49.087165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 711/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:49.998066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2fef3-78cc-452c-a2c4-d7cc9466aa97 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:49.998590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2fef3-78cc-452c-a2c4-d7cc9466aa97 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:49.998688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2fef3-78cc-452c-a2c4-d7cc9466aa97 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:50.000120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:50.005087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600cd9-cdcf-4cfe-8b33-e9362cf07185 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:50.005535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600cd9-cdcf-4cfe-8b33-e9362cf07185 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:50.005687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600cd9-cdcf-4cfe-8b33-e9362cf07185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:50.023718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-97600cd9-cdcf-4cfe-8b33-e9362cf07185 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:50.024933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97600cd9-cdcf-4cfe-8b33-e9362cf07185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:50.033117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:50.183414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2fef3-78cc-452c-a2c4-d7cc9466aa97 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:50.197762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2fef3-78cc-452c-a2c4-d7cc9466aa97 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:50.203805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d913a-890d-46c6-9792-0e30435c8502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:50.204469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d913a-890d-46c6-9792-0e30435c8502 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:50.204757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d913a-890d-46c6-9792-0e30435c8502 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:50.205033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d913a-890d-46c6-9792-0e30435c8502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:50.213015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d913a-890d-46c6-9792-0e30435c8502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:50.214648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d913a-890d-46c6-9792-0e30435c8502 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:50.224845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 719/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:51.115482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fca90-d084-457c-9c88-690606ce335f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:51.116068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fca90-d084-457c-9c88-690606ce335f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:51.116068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fca90-d084-457c-9c88-690606ce335f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:51.117507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:51.122471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aa581-4feb-49c0-91ae-230de29fbb8e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:51.122883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aa581-4feb-49c0-91ae-230de29fbb8e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:51.123027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aa581-4feb-49c0-91ae-230de29fbb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:51.141382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-194aa581-4feb-49c0-91ae-230de29fbb8e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:51.142581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-194aa581-4feb-49c0-91ae-230de29fbb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:51.150423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:51.301557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fca90-d084-457c-9c88-690606ce335f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:51.315679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fca90-d084-457c-9c88-690606ce335f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:51.320936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dfc6c-941e-4fa0-b8c5-b73a4fd2fecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:51.321565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dfc6c-941e-4fa0-b8c5-b73a4fd2fecc service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:51.321849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dfc6c-941e-4fa0-b8c5-b73a4fd2fecc service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:51.322156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dfc6c-941e-4fa0-b8c5-b73a4fd2fecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:51.330091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dfc6c-941e-4fa0-b8c5-b73a4fd2fecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:51.331650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dfc6c-941e-4fa0-b8c5-b73a4fd2fecc service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:51.340971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 714/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:52.222496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516910-00e0-4de7-8b5a-e3a4ad59ab21 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:52.223081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516910-00e0-4de7-8b5a-e3a4ad59ab21 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:52.223081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516910-00e0-4de7-8b5a-e3a4ad59ab21 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:52.224471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:52.229327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e138b-d5cd-4a34-8dac-6ac5c7962d64 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:52.229768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e138b-d5cd-4a34-8dac-6ac5c7962d64 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:52.229883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e138b-d5cd-4a34-8dac-6ac5c7962d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:52.247525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d0e138b-d5cd-4a34-8dac-6ac5c7962d64 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:52.248774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d0e138b-d5cd-4a34-8dac-6ac5c7962d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:52.257050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:52.407838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17516910-00e0-4de7-8b5a-e3a4ad59ab21 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:52.423312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17516910-00e0-4de7-8b5a-e3a4ad59ab21 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:52.428584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724249-ffa1-461c-94b0-6fd60ab8d4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:52.429207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724249-ffa1-461c-94b0-6fd60ab8d4ee service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:52.429485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724249-ffa1-461c-94b0-6fd60ab8d4ee service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:52.429758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724249-ffa1-461c-94b0-6fd60ab8d4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:52.438515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724249-ffa1-461c-94b0-6fd60ab8d4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:52.440078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724249-ffa1-461c-94b0-6fd60ab8d4ee service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:52.449414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 722/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:53.306847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61742b2e-a9ba-4b16-a192-fc005f297a18 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:53.307412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61742b2e-a9ba-4b16-a192-fc005f297a18 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:53.307412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61742b2e-a9ba-4b16-a192-fc005f297a18 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:53.308850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:53.314719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2dfd9-ea2c-4f54-aea7-0b6b5c0ed50f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:53.315125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2dfd9-ea2c-4f54-aea7-0b6b5c0ed50f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:53.315268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2dfd9-ea2c-4f54-aea7-0b6b5c0ed50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:53.333209 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-98c2dfd9-ea2c-4f54-aea7-0b6b5c0ed50f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:53.334404 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-98c2dfd9-ea2c-4f54-aea7-0b6b5c0ed50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:53.342140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:53.494714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61742b2e-a9ba-4b16-a192-fc005f297a18 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:53.509435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61742b2e-a9ba-4b16-a192-fc005f297a18 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:53.515262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1ce95-59bc-4ffe-a5e5-44b83eba0edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:53.516045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ce95-59bc-4ffe-a5e5-44b83eba0edd service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:53.516366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ce95-59bc-4ffe-a5e5-44b83eba0edd service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:53.516647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ce95-59bc-4ffe-a5e5-44b83eba0edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:53.524653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1ce95-59bc-4ffe-a5e5-44b83eba0edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:53.533313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1ce95-59bc-4ffe-a5e5-44b83eba0edd service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:53.536602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 717/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:55.486154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1cc9-f4d5-4ce3-ad7a-a1a41da8f6d9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:55.486728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1cc9-f4d5-4ce3-ad7a-a1a41da8f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:55.486728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1cc9-f4d5-4ce3-ad7a-a1a41da8f6d9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:55.488022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:11:55.493357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e894c-bc3a-4c52-ac90-cc7f57b69be5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:55.493759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e894c-bc3a-4c52-ac90-cc7f57b69be5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:55.493901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e894c-bc3a-4c52-ac90-cc7f57b69be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:55.512489 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-022e894c-bc3a-4c52-ac90-cc7f57b69be5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:55.513662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-022e894c-bc3a-4c52-ac90-cc7f57b69be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:55.521905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:55.561464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1cc9-f4d5-4ce3-ad7a-a1a41da8f6d9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:55.572906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1cc9-f4d5-4ce3-ad7a-a1a41da8f6d9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:55.576424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08b5f4-4a3c-4608-b8fc-772c281b7b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:55.577067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b5f4-4a3c-4608-b8fc-772c281b7b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:55.577352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b5f4-4a3c-4608-b8fc-772c281b7b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:55.577639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b5f4-4a3c-4608-b8fc-772c281b7b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:55.586949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b5f4-4a3c-4608-b8fc-772c281b7b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:55.588422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b5f4-4a3c-4608-b8fc-772c281b7b0e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:55.598066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 725/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:11:57.866494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754cf42-daaf-41eb-b18e-9886b2a6ff0d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:57.867037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754cf42-daaf-41eb-b18e-9886b2a6ff0d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:57.867037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754cf42-daaf-41eb-b18e-9886b2a6ff0d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:57.868428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:11:57.873764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cbd8f-aaf3-4fa3-8dd7-b6b16c766067 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:57.874208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cbd8f-aaf3-4fa3-8dd7-b6b16c766067 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:57.874353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cbd8f-aaf3-4fa3-8dd7-b6b16c766067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:57.892524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3e7cbd8f-aaf3-4fa3-8dd7-b6b16c766067 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:11:57.893710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3e7cbd8f-aaf3-4fa3-8dd7-b6b16c766067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:11:57.901480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:11:57.940690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754cf42-daaf-41eb-b18e-9886b2a6ff0d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:11:57.951165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754cf42-daaf-41eb-b18e-9886b2a6ff0d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:11:57.954738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955c6d-4208-4a4f-83bb-c56331e5ead7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:11:57.955471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955c6d-4208-4a4f-83bb-c56331e5ead7 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:11:57.955723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955c6d-4208-4a4f-83bb-c56331e5ead7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:11:57.956006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955c6d-4208-4a4f-83bb-c56331e5ead7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:11:57.964860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955c6d-4208-4a4f-83bb-c56331e5ead7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:11:57.966262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955c6d-4208-4a4f-83bb-c56331e5ead7 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:11:57.976738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 720/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:00.441085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e098a4-8294-4d38-b36a-b48b46675adf None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:00.441744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e098a4-8294-4d38-b36a-b48b46675adf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:00.441744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e098a4-8294-4d38-b36a-b48b46675adf None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:00.443009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:00.448305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44baf62-0c91-4840-a103-761ed7076ff3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:00.448691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44baf62-0c91-4840-a103-761ed7076ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:00.448879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44baf62-0c91-4840-a103-761ed7076ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:00.466270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b44baf62-0c91-4840-a103-761ed7076ff3 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:00.467453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b44baf62-0c91-4840-a103-761ed7076ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:00.475833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:00.514078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e098a4-8294-4d38-b36a-b48b46675adf None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:00.524804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e098a4-8294-4d38-b36a-b48b46675adf None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:00.533399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564e0c7-9f72-4563-b6b2-1a55a58b943a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:00.533399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564e0c7-9f72-4563-b6b2-1a55a58b943a service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:00.533399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564e0c7-9f72-4563-b6b2-1a55a58b943a service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:00.533399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564e0c7-9f72-4563-b6b2-1a55a58b943a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:00.539130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564e0c7-9f72-4563-b6b2-1a55a58b943a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:00.540844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564e0c7-9f72-4563-b6b2-1a55a58b943a service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:00.550973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 728/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:02.712593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b35d-0649-4af1-ae9a-ee97223c3fec None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:02.713120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b35d-0649-4af1-ae9a-ee97223c3fec None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:02.713120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b35d-0649-4af1-ae9a-ee97223c3fec None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:02.714536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:02.719941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75afa9-be81-43c3-8d0e-f1896ae442b0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:02.720372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75afa9-be81-43c3-8d0e-f1896ae442b0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:02.720529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75afa9-be81-43c3-8d0e-f1896ae442b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:02.737917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7f75afa9-be81-43c3-8d0e-f1896ae442b0 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:02.739101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7f75afa9-be81-43c3-8d0e-f1896ae442b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:02.747084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:02.786370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b35d-0649-4af1-ae9a-ee97223c3fec None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:02.797455 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b35d-0649-4af1-ae9a-ee97223c3fec None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:02.801016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6186-54ab-475b-b279-ec5bce9277ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:02.801647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6186-54ab-475b-b279-ec5bce9277ed service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:02.801929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6186-54ab-475b-b279-ec5bce9277ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:02.802204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6186-54ab-475b-b279-ec5bce9277ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:02.811000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb6186-54ab-475b-b279-ec5bce9277ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:02.812949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb6186-54ab-475b-b279-ec5bce9277ed service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:02.822260 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 723/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:04.913803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219230-b225-4850-9846-4aeb6857e1bb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:04.914316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219230-b225-4850-9846-4aeb6857e1bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:04.914316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219230-b225-4850-9846-4aeb6857e1bb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:04.915954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:04.921152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac188-3447-46bc-8af9-00d4669fef5c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:04.921685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac188-3447-46bc-8af9-00d4669fef5c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:04.922065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac188-3447-46bc-8af9-00d4669fef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:04.940033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-61cac188-3447-46bc-8af9-00d4669fef5c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:04.941256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-61cac188-3447-46bc-8af9-00d4669fef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:04.949081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:04.987102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05219230-b225-4850-9846-4aeb6857e1bb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:04.998006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05219230-b225-4850-9846-4aeb6857e1bb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:05.002209 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95154698-5df4-4725-8c21-82c54a3502a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:05.002838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154698-5df4-4725-8c21-82c54a3502a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:05.003120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154698-5df4-4725-8c21-82c54a3502a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:05.003397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154698-5df4-4725-8c21-82c54a3502a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:05.012175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95154698-5df4-4725-8c21-82c54a3502a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:05.013619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95154698-5df4-4725-8c21-82c54a3502a5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:05.023750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 731/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:07.100771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44d29-1d10-4640-a795-681b3249c67e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:07.101384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44d29-1d10-4640-a795-681b3249c67e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:07.101384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44d29-1d10-4640-a795-681b3249c67e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:07.102707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:07.107948 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b517a0-774a-42e9-90d4-6a9b57f1edc8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:07.108420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b517a0-774a-42e9-90d4-6a9b57f1edc8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:07.108533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b517a0-774a-42e9-90d4-6a9b57f1edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:07.126674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-66b517a0-774a-42e9-90d4-6a9b57f1edc8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:07.127854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-66b517a0-774a-42e9-90d4-6a9b57f1edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:07.135621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:07.173866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44d29-1d10-4640-a795-681b3249c67e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:07.184339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44d29-1d10-4640-a795-681b3249c67e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:07.188416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da067-b834-4a5d-919f-9df566cb1a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:07.189064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da067-b834-4a5d-919f-9df566cb1a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:07.189353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da067-b834-4a5d-919f-9df566cb1a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:07.189632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da067-b834-4a5d-919f-9df566cb1a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:07.198693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da067-b834-4a5d-919f-9df566cb1a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:07.200116 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da067-b834-4a5d-919f-9df566cb1a49 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:07.209982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 726/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:09.344390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124f48-f7fa-413b-8a7b-170688afb8a0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:09.344965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124f48-f7fa-413b-8a7b-170688afb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:09.344965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124f48-f7fa-413b-8a7b-170688afb8a0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:09.346314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:09.351563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b88a-e24e-4db9-a2cf-61f49ccbd6ce None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:09.351991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b88a-e24e-4db9-a2cf-61f49ccbd6ce None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:09.352110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b88a-e24e-4db9-a2cf-61f49ccbd6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:09.358105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=70 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:12:09.370969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2115b88a-e24e-4db9-a2cf-61f49ccbd6ce None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:09.374051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2115b88a-e24e-4db9-a2cf-61f49ccbd6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:09.380794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:09.419345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45124f48-f7fa-413b-8a7b-170688afb8a0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:09.425489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=73 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:12:09.431121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45124f48-f7fa-413b-8a7b-170688afb8a0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:09.434907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f0ff1-b462-44e9-9d4f-dcdcbb32cdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:09.435567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0ff1-b462-44e9-9d4f-dcdcbb32cdbf service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:09.435852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0ff1-b462-44e9-9d4f-dcdcbb32cdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:09.436131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0ff1-b462-44e9-9d4f-dcdcbb32cdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:09.445157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f0ff1-b462-44e9-9d4f-dcdcbb32cdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:09.446757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f0ff1-b462-44e9-9d4f-dcdcbb32cdbf service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:09.457071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 734/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:11.682182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea32323-e57d-49ac-b079-9fd150b14b8f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:11.682651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea32323-e57d-49ac-b079-9fd150b14b8f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:11.682775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea32323-e57d-49ac-b079-9fd150b14b8f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:11.684102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:11.689802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86c306-2043-49fb-ae03-2f0e6d641cff None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:11.690206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86c306-2043-49fb-ae03-2f0e6d641cff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:11.690359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86c306-2043-49fb-ae03-2f0e6d641cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:11.707683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5d86c306-2043-49fb-ae03-2f0e6d641cff None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:11.708937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5d86c306-2043-49fb-ae03-2f0e6d641cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:11.717303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:12:11.758181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea32323-e57d-49ac-b079-9fd150b14b8f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:11.769253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea32323-e57d-49ac-b079-9fd150b14b8f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:11.772770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa29a3-c726-4071-87ca-427892848dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:11.773393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa29a3-c726-4071-87ca-427892848dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:11.773672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa29a3-c726-4071-87ca-427892848dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:11.773947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa29a3-c726-4071-87ca-427892848dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:11.783625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa29a3-c726-4071-87ca-427892848dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:11.785725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa29a3-c726-4071-87ca-427892848dc7 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:11.798191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 729/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:13.986028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db55ded-0771-4bcb-bda4-b6e90c0eda14 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:13.986558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db55ded-0771-4bcb-bda4-b6e90c0eda14 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:13.986558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db55ded-0771-4bcb-bda4-b6e90c0eda14 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:13.987874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:13.993236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda652a1-03ee-41e3-a3a1-f38b8ce019f8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:13.993694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda652a1-03ee-41e3-a3a1-f38b8ce019f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:13.993981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda652a1-03ee-41e3-a3a1-f38b8ce019f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:14.012569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cda652a1-03ee-41e3-a3a1-f38b8ce019f8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:14.013764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cda652a1-03ee-41e3-a3a1-f38b8ce019f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:14.022757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:14.060577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db55ded-0771-4bcb-bda4-b6e90c0eda14 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:14.072189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db55ded-0771-4bcb-bda4-b6e90c0eda14 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:14.075779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57da19-c7c0-4de5-af3c-66f9911ee6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:14.076460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57da19-c7c0-4de5-af3c-66f9911ee6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:14.076775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57da19-c7c0-4de5-af3c-66f9911ee6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:14.077040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57da19-c7c0-4de5-af3c-66f9911ee6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:14.087166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57da19-c7c0-4de5-af3c-66f9911ee6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:14.088651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57da19-c7c0-4de5-af3c-66f9911ee6a4 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:14.098169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 737/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:16.179252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2b704-b5db-4f11-93f0-28e4aefeb350 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:16.179815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2b704-b5db-4f11-93f0-28e4aefeb350 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:16.179919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2b704-b5db-4f11-93f0-28e4aefeb350 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:16.181306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:16.186561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a48e6-b134-4fd4-bb29-11b2f634a121 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:16.187001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a48e6-b134-4fd4-bb29-11b2f634a121 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:16.187263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a48e6-b134-4fd4-bb29-11b2f634a121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:16.204621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2e6a48e6-b134-4fd4-bb29-11b2f634a121 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:16.205800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2e6a48e6-b134-4fd4-bb29-11b2f634a121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:16.213483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:16.250681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2b704-b5db-4f11-93f0-28e4aefeb350 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:16.261391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2b704-b5db-4f11-93f0-28e4aefeb350 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:16.264964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5e70d-e237-48be-9d21-8ae6b8bb29f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:16.265601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5e70d-e237-48be-9d21-8ae6b8bb29f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:16.265881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5e70d-e237-48be-9d21-8ae6b8bb29f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:16.266160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5e70d-e237-48be-9d21-8ae6b8bb29f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:16.274971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5e70d-e237-48be-9d21-8ae6b8bb29f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:16.276417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5e70d-e237-48be-9d21-8ae6b8bb29f1 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:16.286227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 732/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:26.199551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=17 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:12:26.282044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=17 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:12:36.194227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffe63d-28a4-4857-bc84-8328f2912f00 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:36.194802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffe63d-28a4-4857-bc84-8328f2912f00 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:36.194802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffe63d-28a4-4857-bc84-8328f2912f00 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:36.196221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 739/1471] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:36.201786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590eeba-3e13-43ad-a9de-25e1d2dd2592 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:36.202243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590eeba-3e13-43ad-a9de-25e1d2dd2592 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:36.202350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590eeba-3e13-43ad-a9de-25e1d2dd2592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:36.220708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9590eeba-3e13-43ad-a9de-25e1d2dd2592 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:36.221892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9590eeba-3e13-43ad-a9de-25e1d2dd2592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:36.229664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 733/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:36.277360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44846-c665-43c4-9504-3e4217e968ea None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:36.277649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44846-c665-43c4-9504-3e4217e968ea None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:36.277929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44846-c665-43c4-9504-3e4217e968ea None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:36.279280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 740/1473] 10.222.0.42 () {54 vars in 962 bytes} [Fri Jun 24 08:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:36.284474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679273-8a1e-42f5-a5d5-42a05ab40591 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:36.284771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679273-8a1e-42f5-a5d5-42a05ab40591 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:36.285056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679273-8a1e-42f5-a5d5-42a05ab40591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:36.303206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4c679273-8a1e-42f5-a5d5-42a05ab40591 None None] MFA Rules not processed for user `d61999e7673a4a1cbc5ad487f8d16845`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:36.304425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4c679273-8a1e-42f5-a5d5-42a05ab40591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:36.310863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 734/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Jun 24 08:12:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:36.318601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a44846-c665-43c4-9504-3e4217e968ea None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:36.329980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a44846-c665-43c4-9504-3e4217e968ea None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:36.333485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd764a-902e-4967-9391-8ee55bf8255c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:36.334108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd764a-902e-4967-9391-8ee55bf8255c service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:36.334388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd764a-902e-4967-9391-8ee55bf8255c service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:36.334663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd764a-902e-4967-9391-8ee55bf8255c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:36.343594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd764a-902e-4967-9391-8ee55bf8255c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:36.345094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd764a-902e-4967-9391-8ee55bf8255c service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:36.354278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 741/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:38.483826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8bc0e-1944-4807-bf9e-bd30cea44c49 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:38.484864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8bc0e-1944-4807-bf9e-bd30cea44c49 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:38.485178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8bc0e-1944-4807-bf9e-bd30cea44c49 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:38.486684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 735/1476] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:38.492116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff705-5232-499f-b2e2-00556995dd70 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:38.492556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff705-5232-499f-b2e2-00556995dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:38.492711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff705-5232-499f-b2e2-00556995dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:38.510628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-487ff705-5232-499f-b2e2-00556995dd70 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:38.511813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-487ff705-5232-499f-b2e2-00556995dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:38.520455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 742/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:38.544095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8bc0e-1944-4807-bf9e-bd30cea44c49 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:38.557295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8bc0e-1944-4807-bf9e-bd30cea44c49 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:38.561707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c863a-f778-42a7-a27c-0f85380d3040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:38.562838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c863a-f778-42a7-a27c-0f85380d3040 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:38.563235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c863a-f778-42a7-a27c-0f85380d3040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:38.563511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c863a-f778-42a7-a27c-0f85380d3040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:38.564257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c863a-f778-42a7-a27c-0f85380d3040 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:38.566052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-313c863a-f778-42a7-a27c-0f85380d3040 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:12:38.566052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:12:38.566052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:12:38.567251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c863a-f778-42a7-a27c-0f85380d3040 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:38.588119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 736/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 08:12:38 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:12:40.632662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a1ae6-56fd-4295-a086-aa8819057c41 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:40.633200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a1ae6-56fd-4295-a086-aa8819057c41 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:40.633200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a1ae6-56fd-4295-a086-aa8819057c41 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:40.634606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 743/1479] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:40.640008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c6a8-bd11-4884-9db5-7e098482c5dd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:40.641339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c6a8-bd11-4884-9db5-7e098482c5dd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:40.641674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c6a8-bd11-4884-9db5-7e098482c5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:40.660298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-80a5c6a8-bd11-4884-9db5-7e098482c5dd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:40.661475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-80a5c6a8-bd11-4884-9db5-7e098482c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:40.669434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 737/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:40.712965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a1ae6-56fd-4295-a086-aa8819057c41 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:40.727540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a1ae6-56fd-4295-a086-aa8819057c41 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:40.733180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0bf1a-293c-406a-b3e7-19497845de75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:40.733812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bf1a-293c-406a-b3e7-19497845de75 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:40.734094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bf1a-293c-406a-b3e7-19497845de75 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:40.734369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bf1a-293c-406a-b3e7-19497845de75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:40.742588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0bf1a-293c-406a-b3e7-19497845de75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:40.744213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0bf1a-293c-406a-b3e7-19497845de75 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:40.753993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 744/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:42.977198 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61eb5f-b0b7-404b-b91f-2e055f3a2857 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:42.977712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61eb5f-b0b7-404b-b91f-2e055f3a2857 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:42.977712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61eb5f-b0b7-404b-b91f-2e055f3a2857 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:42.979144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 738/1482] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:42.984564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878f218-5f5d-4bed-83f6-cad23c20e490 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:42.984997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878f218-5f5d-4bed-83f6-cad23c20e490 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:42.985154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878f218-5f5d-4bed-83f6-cad23c20e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:43.003139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d878f218-5f5d-4bed-83f6-cad23c20e490 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:43.004371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d878f218-5f5d-4bed-83f6-cad23c20e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:43.012164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 745/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:43.048095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61eb5f-b0b7-404b-b91f-2e055f3a2857 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:43.058595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61eb5f-b0b7-404b-b91f-2e055f3a2857 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:43.062574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5cf8e-b245-496b-8788-8befd6dcffca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:43.063310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5cf8e-b245-496b-8788-8befd6dcffca service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:43.063593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5cf8e-b245-496b-8788-8befd6dcffca service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:43.063869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5cf8e-b245-496b-8788-8befd6dcffca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:43.072599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5cf8e-b245-496b-8788-8befd6dcffca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:43.074007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5cf8e-b245-496b-8788-8befd6dcffca service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:43.083790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 739/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:12:45.167131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e1cc-f491-457a-b131-deceffdafbad None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:45.167697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e1cc-f491-457a-b131-deceffdafbad None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:45.167697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e1cc-f491-457a-b131-deceffdafbad None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:45.169093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 746/1485] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:45.174862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2ad6c-df3e-4022-a022-405accd1a0b9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:45.175269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2ad6c-df3e-4022-a022-405accd1a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:45.175451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2ad6c-df3e-4022-a022-405accd1a0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:45.193740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-20d2ad6c-df3e-4022-a022-405accd1a0b9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:45.194940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-20d2ad6c-df3e-4022-a022-405accd1a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:45.203111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 740/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:45.241683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198e1cc-f491-457a-b131-deceffdafbad None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:45.252461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198e1cc-f491-457a-b131-deceffdafbad None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:45.255936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffc19-20c2-4d65-8245-0e87c7e67fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:45.256596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffc19-20c2-4d65-8245-0e87c7e67fed service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:45.256877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffc19-20c2-4d65-8245-0e87c7e67fed service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:45.257151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffc19-20c2-4d65-8245-0e87c7e67fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:45.266132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ffc19-20c2-4d65-8245-0e87c7e67fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:45.267570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ffc19-20c2-4d65-8245-0e87c7e67fed service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:45.277010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 747/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:47.407031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0644e4-b370-4752-a38d-fb2721003f45 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:47.407605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0644e4-b370-4752-a38d-fb2721003f45 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:47.407605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0644e4-b370-4752-a38d-fb2721003f45 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:47.409093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 741/1488] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:47.414220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ede22-dd56-481e-be68-e92aed16ab94 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:47.414647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ede22-dd56-481e-be68-e92aed16ab94 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:47.414777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ede22-dd56-481e-be68-e92aed16ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:47.433764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-048ede22-dd56-481e-be68-e92aed16ab94 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:47.434937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-048ede22-dd56-481e-be68-e92aed16ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:47.443661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 748/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:47.485183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0644e4-b370-4752-a38d-fb2721003f45 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:47.495682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0644e4-b370-4752-a38d-fb2721003f45 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:47.499205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf20fa-e6ec-429a-a1a2-4bd6c2acc528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:47.500296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf20fa-e6ec-429a-a1a2-4bd6c2acc528 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:47.500585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf20fa-e6ec-429a-a1a2-4bd6c2acc528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:47.500863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf20fa-e6ec-429a-a1a2-4bd6c2acc528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:47.509524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf20fa-e6ec-429a-a1a2-4bd6c2acc528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:47.510933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf20fa-e6ec-429a-a1a2-4bd6c2acc528 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:47.520687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 742/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:49.942352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820712-09fd-49b5-8ab4-9e04e3c9acd6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:49.942869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820712-09fd-49b5-8ab4-9e04e3c9acd6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:49.942869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85820712-09fd-49b5-8ab4-9e04e3c9acd6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:49.944241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 749/1491] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 08:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:12:49.949603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461314-3e27-4cda-a52b-74a0281e8995 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:49.950374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461314-3e27-4cda-a52b-74a0281e8995 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:49.950659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461314-3e27-4cda-a52b-74a0281e8995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:49.970171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e5461314-3e27-4cda-a52b-74a0281e8995 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:12:49.971602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e5461314-3e27-4cda-a52b-74a0281e8995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:12:49.984282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 743/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 08:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:12:50.018635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820712-09fd-49b5-8ab4-9e04e3c9acd6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:12:50.029890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85820712-09fd-49b5-8ab4-9e04e3c9acd6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:12:50.033817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a42e-e81b-48dd-b2ef-32529d80476e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:12:50.034520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a42e-e81b-48dd-b2ef-32529d80476e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:12:50.034867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a42e-e81b-48dd-b2ef-32529d80476e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:12:50.035206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a42e-e81b-48dd-b2ef-32529d80476e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:12:50.045280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4a42e-e81b-48dd-b2ef-32529d80476e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:12:50.046903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4a42e-e81b-48dd-b2ef-32529d80476e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:12:50.057116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 750/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:12:59.963926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=33 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:13:00.052375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=33 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:14:27.634060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975fed-37c9-47da-808f-57359aa84a2c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:27.634615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975fed-37c9-47da-808f-57359aa84a2c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:27.634615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975fed-37c9-47da-808f-57359aa84a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:27.652865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7c975fed-37c9-47da-808f-57359aa84a2c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:14:27.654053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7c975fed-37c9-47da-808f-57359aa84a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:14:27.661907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 744/1494] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:14:27.671407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46959a-f38e-48d1-a9c5-f8e71a529fc8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:27.671912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46959a-f38e-48d1-a9c5-f8e71a529fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:27.672034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46959a-f38e-48d1-a9c5-f8e71a529fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:27.690039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4d46959a-f38e-48d1-a9c5-f8e71a529fc8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:14:27.691220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4d46959a-f38e-48d1-a9c5-f8e71a529fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:14:27.699682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 751/1495] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:14:27.704495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975fed-37c9-47da-808f-57359aa84a2c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:27.715267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975fed-37c9-47da-808f-57359aa84a2c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:27.719873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:27.720557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:27.720868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:27.721140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:27.721955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:14:27.722266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:27.723290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:27.723290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:14:27.723290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:14:27.724154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:27.736274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 745/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:14:27.756229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46959a-f38e-48d1-a9c5-f8e71a529fc8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:27.766526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46959a-f38e-48d1-a9c5-f8e71a529fc8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:27.771177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:27.774142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:27.774142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:27.774142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:27.774142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:27.775566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING py.warnings [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:27.775566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: warnings.warn(msg) Jun 24 08:14:27.775566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: Jun 24 08:14:27.776795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:27.872722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 752/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:14:27 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:14:27.876857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:27.887069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4089424-612a-49b2-a527-d3364eb611a0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:27.942396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:27.943185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:27.943468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:27.943748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:27.944873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:27.945588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:27.945588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:14:27.945588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:14:27.946793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:28.044166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 746/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:14:27 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:14:28.048588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:28.059372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5244c-07ef-4910-8888-d3bf15e00ad6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:28.064141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:28.064821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.065138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.065395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.066114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:28.067132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING py.warnings [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:28.067132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: warnings.warn(msg) Jun 24 08:14:28.067132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: Jun 24 08:14:28.068009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:28.081372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 753/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:14:28.086693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:28.096431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321e67-c5a0-40aa-901a-d94869ca63ed admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:28.102089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b751f-6f84-4983-8826-c3117f0f2219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:28.102736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b751f-6f84-4983-8826-c3117f0f2219 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.103016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b751f-6f84-4983-8826-c3117f0f2219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.103288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b751f-6f84-4983-8826-c3117f0f2219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.104007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b751f-6f84-4983-8826-c3117f0f2219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:28.105049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-5c9b751f-6f84-4983-8826-c3117f0f2219 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:28.105049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:14:28.105049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:14:28.105926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b751f-6f84-4983-8826-c3117f0f2219 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:28.119414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 747/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:14:28.123470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:28.133319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f8da5-0f38-433f-93d6-783bfd2e2c4e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:28.137815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea618-ef3b-4fd2-af81-1d9bd0daddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:28.138688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea618-ef3b-4fd2-af81-1d9bd0daddf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.138970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea618-ef3b-4fd2-af81-1d9bd0daddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.139247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea618-ef3b-4fd2-af81-1d9bd0daddf7 admin admin] PATH_INFO: `/v3/projects/ccd6d3c1683f49e7a47e63c2edbaaf42/users/4fdf6ec1e3db4964927201008e133d55/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.155168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea618-ef3b-4fd2-af81-1d9bd0daddf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd6d3c1683f49e7a47e63c2edbaaf42, user_id=4fdf6ec1e3db4964927201008e133d55, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:28.156232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING py.warnings [None req-c2dea618-ef3b-4fd2-af81-1d9bd0daddf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:28.156232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: warnings.warn(msg) Jun 24 08:14:28.156232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: Jun 24 08:14:28.158196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea618-ef3b-4fd2-af81-1d9bd0daddf7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:28.334557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 754/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:14:28 2022] PUT /identity/v3/projects/ccd6d3c1683f49e7a47e63c2edbaaf42/users/4fdf6ec1e3db4964927201008e133d55/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:14:28.346708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b056-c9db-42c3-af12-386853c2b034 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.346979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b056-c9db-42c3-af12-386853c2b034 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.347257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b056-c9db-42c3-af12-386853c2b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.372471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-26a7b056-c9db-42c3-af12-386853c2b034 None None] MFA Rules not processed for user `4fdf6ec1e3db4964927201008e133d55`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:14:28.373717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-26a7b056-c9db-42c3-af12-386853c2b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:14:28.436704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 748/1502] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:14:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:14:28.450618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d21e-1964-4d2d-8fd7-4ac0b820d508 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.450905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d21e-1964-4d2d-8fd7-4ac0b820d508 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.451185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d21e-1964-4d2d-8fd7-4ac0b820d508 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.452607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 755/1503] 10.222.0.42 () {54 vars in 963 bytes} [Fri Jun 24 08:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:14:28.457583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3f0a-2aff-4b46-b3b5-bb453ee29423 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.457884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3f0a-2aff-4b46-b3b5-bb453ee29423 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.458174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3f0a-2aff-4b46-b3b5-bb453ee29423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.476594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2daf3f0a-2aff-4b46-b3b5-bb453ee29423 None None] MFA Rules not processed for user `32681494192c4f6c9ba36d68e4b6399b`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:14:28.477786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2daf3f0a-2aff-4b46-b3b5-bb453ee29423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:14:28.520503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:14:28.528705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 749/1504] 10.222.0.42 () {58 vars in 1060 bytes} [Fri Jun 24 08:14:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:14:28.536540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7d21e-1964-4d2d-8fd7-4ac0b820d508 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:28.547337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7d21e-1964-4d2d-8fd7-4ac0b820d508 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:28.550842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:28.551476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.551759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.552037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.560812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:28.562223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:28.572017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 756/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:14:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:14:28.614395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696178e-2200-4bee-a8ee-ffc50f6a983d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.614688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696178e-2200-4bee-a8ee-ffc50f6a983d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.614971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696178e-2200-4bee-a8ee-ffc50f6a983d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.616901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 750/1506] 10.222.0.42 () {52 vars in 829 bytes} [Fri Jun 24 08:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:14:28.620797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:28.683625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051c354-1a28-45ab-ad74-7173f288e12b service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:28.688122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:28.689013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:28.689292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:28.689568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] PATH_INFO: `/v3/users/4fdf6ec1e3db4964927201008e133d55` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:28.690755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fdf6ec1e3db4964927201008e133d55)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:28.691761 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING py.warnings [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:28.691761 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: warnings.warn(msg) Jun 24 08:14:28.691761 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: Jun 24 08:14:28.693038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:28.924616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fdf6ec1e3db4964927201008e133d55'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:28.936859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fdf6ec1e3db4964927201008e133d55'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:28.937574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fdf6ec1e3db4964927201008e133d55'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:28.938181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fdf6ec1e3db4964927201008e133d55'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:28.956584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fdf6ec1e3db4964927201008e133d55'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:28.961173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:14:29.106725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 757/1507] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:14:28 2022] DELETE /identity/v3/users/4fdf6ec1e3db4964927201008e133d55 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:14:29.111141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:29.111638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:29.111758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:29.129675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:14:29.130864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:14:29.188676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 751/1508] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:14:29.198212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:29.199617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:14:29.255967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9514f72-c349-4c39-b863-233416b175b1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:29.260078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775891-9252-434a-9940-ee2b0e6d2394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:29.260749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775891-9252-434a-9940-ee2b0e6d2394 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:29.261033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775891-9252-434a-9940-ee2b0e6d2394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:29.261312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775891-9252-434a-9940-ee2b0e6d2394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:29.270132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37775891-9252-434a-9940-ee2b0e6d2394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:29.271557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37775891-9252-434a-9940-ee2b0e6d2394 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:29.281079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 758/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:14:29.685801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:14:29.687293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:14:29.699746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea635-5422-4308-a280-33a225e87a53 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:14:29.704474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:14:29.706135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:14:29.706431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:14:29.706714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] PATH_INFO: `/v3/projects/ccd6d3c1683f49e7a47e63c2edbaaf42` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:14:29.707977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd6d3c1683f49e7a47e63c2edbaaf42)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:14:29.709082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:14:29.709082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:14:29.709082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:14:29.710467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:14:29.847147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd6d3c1683f49e7a47e63c2edbaaf42', 'request_id': 'req-388dd2bc-126f-4782-8405-9958f2056258'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:29.853896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd6d3c1683f49e7a47e63c2edbaaf42', 'request_id': 'req-388dd2bc-126f-4782-8405-9958f2056258'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:29.911772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd6d3c1683f49e7a47e63c2edbaaf42', 'request_id': 'req-388dd2bc-126f-4782-8405-9958f2056258'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:29.933408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] The token cache is being invalidate because project ccd6d3c1683f49e7a47e63c2edbaaf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:14:29.933695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:29.934427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-388dd2bc-126f-4782-8405-9958f2056258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:14:29.935960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 752/1510] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:14:29 2022] DELETE /identity/v3/projects/ccd6d3c1683f49e7a47e63c2edbaaf42 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:14:39.276821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:14:39.930237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:16:11.486284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac161-d6e6-4e33-b129-0715512ea81b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:11.486885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac161-d6e6-4e33-b129-0715512ea81b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:11.486885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac161-d6e6-4e33-b129-0715512ea81b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:11.488252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:11.493296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36084e-0465-48fa-beb9-b53ff8843a16 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:11.493761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36084e-0465-48fa-beb9-b53ff8843a16 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:11.493945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36084e-0465-48fa-beb9-b53ff8843a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:11.512163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bd36084e-0465-48fa-beb9-b53ff8843a16 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:11.513431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd36084e-0465-48fa-beb9-b53ff8843a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:11.573273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:11.729226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdac161-d6e6-4e33-b129-0715512ea81b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:11.735289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fcdac161-d6e6-4e33-b129-0715512ea81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:11.807629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdac161-d6e6-4e33-b129-0715512ea81b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:11.813031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40cfb-b0bd-43f0-ab5d-7655e5fa9bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:11.813681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40cfb-b0bd-43f0-ab5d-7655e5fa9bb6 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:11.813995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40cfb-b0bd-43f0-ab5d-7655e5fa9bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:11.814279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40cfb-b0bd-43f0-ab5d-7655e5fa9bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:11.823177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40cfb-b0bd-43f0-ab5d-7655e5fa9bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:11.824841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40cfb-b0bd-43f0-ab5d-7655e5fa9bb6 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:11.834235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 760/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:12.669096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a338103-4a3c-40ca-b390-fb536f754def None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:12.669626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a338103-4a3c-40ca-b390-fb536f754def None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:12.669626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a338103-4a3c-40ca-b390-fb536f754def None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:12.671014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:12.676269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840bee2-c796-4da7-a94a-4f761ea239bc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:12.676680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840bee2-c796-4da7-a94a-4f761ea239bc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:12.676833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840bee2-c796-4da7-a94a-4f761ea239bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:12.697583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c840bee2-c796-4da7-a94a-4f761ea239bc None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:12.698775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c840bee2-c796-4da7-a94a-4f761ea239bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:12.706599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:12.857947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a338103-4a3c-40ca-b390-fb536f754def None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:12.874442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a338103-4a3c-40ca-b390-fb536f754def None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:12.880045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785baef-9a5f-4488-b2a9-2f1e4b6116b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:12.880741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785baef-9a5f-4488-b2a9-2f1e4b6116b1 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:12.881022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785baef-9a5f-4488-b2a9-2f1e4b6116b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:12.881335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785baef-9a5f-4488-b2a9-2f1e4b6116b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:12.890640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785baef-9a5f-4488-b2a9-2f1e4b6116b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:12.892316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785baef-9a5f-4488-b2a9-2f1e4b6116b1 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:12.903000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 755/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:12.930361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c94a34-4885-49d6-bb1f-2623cfa4198e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:12.930582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c94a34-4885-49d6-bb1f-2623cfa4198e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:12.930857 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c94a34-4885-49d6-bb1f-2623cfa4198e None None] PATH_INFO: `/v3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:12.932158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 762/1517] 10.222.0.26 () {54 vars in 925 bytes} [Fri Jun 24 08:16:12 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:16:12.939231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748ea6-d704-49c2-9f2a-a74504391c0e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:12.939523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748ea6-d704-49c2-9f2a-a74504391c0e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:12.939801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748ea6-d704-49c2-9f2a-a74504391c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:12.960955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1a748ea6-d704-49c2-9f2a-a74504391c0e None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:12.962180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1a748ea6-d704-49c2-9f2a-a74504391c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:13.028462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 756/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Jun 24 08:16:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:22.324800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f6c8-bfdc-4208-8eb1-85724b78ba73 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:22.325340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f6c8-bfdc-4208-8eb1-85724b78ba73 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:22.325340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f6c8-bfdc-4208-8eb1-85724b78ba73 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:22.326656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 763/1519] 10.222.0.42 () {54 vars in 960 bytes} [Fri Jun 24 08:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:22.331630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcdedc-4fca-449b-a56c-2d0a698175df None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:22.332032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcdedc-4fca-449b-a56c-2d0a698175df None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:22.332186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcdedc-4fca-449b-a56c-2d0a698175df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:22.350704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-96bcdedc-4fca-449b-a56c-2d0a698175df None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:22.352984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-96bcdedc-4fca-449b-a56c-2d0a698175df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:22.361381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 757/1520] 10.222.0.42 () {58 vars in 1057 bytes} [Fri Jun 24 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:22.369997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328f6c8-bfdc-4208-8eb1-85724b78ba73 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:22.383402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328f6c8-bfdc-4208-8eb1-85724b78ba73 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:22.388382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e138d4-6e2c-4b13-811e-580646eb4af7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:22.389048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e138d4-6e2c-4b13-811e-580646eb4af7 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:22.389328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e138d4-6e2c-4b13-811e-580646eb4af7 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:22.389597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e138d4-6e2c-4b13-811e-580646eb4af7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:22.397915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e138d4-6e2c-4b13-811e-580646eb4af7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:22.399476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e138d4-6e2c-4b13-811e-580646eb4af7 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:22.408959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 764/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:24.179408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6526b8-6249-40eb-bfeb-7e5a5efda4ab None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:24.180431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6526b8-6249-40eb-bfeb-7e5a5efda4ab None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:24.180431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6526b8-6249-40eb-bfeb-7e5a5efda4ab None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:24.181813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:24.186565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330abbba-fe5f-4496-9344-f4837a425bc8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:24.187015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330abbba-fe5f-4496-9344-f4837a425bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:24.187114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330abbba-fe5f-4496-9344-f4837a425bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:24.205748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-330abbba-fe5f-4496-9344-f4837a425bc8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:24.206927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-330abbba-fe5f-4496-9344-f4837a425bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:24.215048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:24.381398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6526b8-6249-40eb-bfeb-7e5a5efda4ab None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:24.399973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6526b8-6249-40eb-bfeb-7e5a5efda4ab None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:24.405575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde6b85-5731-483e-8f90-fd9f4ce721bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:24.406218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6b85-5731-483e-8f90-fd9f4ce721bd service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:24.406494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6b85-5731-483e-8f90-fd9f4ce721bd service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:24.406767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6b85-5731-483e-8f90-fd9f4ce721bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:24.416041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde6b85-5731-483e-8f90-fd9f4ce721bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:24.417978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde6b85-5731-483e-8f90-fd9f4ce721bd service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:24.427286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 759/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:25.254266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a545-f66d-4404-86d4-dbce402be814 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:25.254831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a545-f66d-4404-86d4-dbce402be814 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:25.254831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a545-f66d-4404-86d4-dbce402be814 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:25.256219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:25.261767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d480c-9496-405b-859e-86bc5f8a114d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:25.262228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d480c-9496-405b-859e-86bc5f8a114d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:25.262338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d480c-9496-405b-859e-86bc5f8a114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:25.280915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-883d480c-9496-405b-859e-86bc5f8a114d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:25.282102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-883d480c-9496-405b-859e-86bc5f8a114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:25.290113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:16:25.442243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85a545-f66d-4404-86d4-dbce402be814 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:25.456923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85a545-f66d-4404-86d4-dbce402be814 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:25.462247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c6737-81b4-4f1b-88f8-7867a87f3beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:25.463400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6737-81b4-4f1b-88f8-7867a87f3beb service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:25.463692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6737-81b4-4f1b-88f8-7867a87f3beb service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:25.463962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6737-81b4-4f1b-88f8-7867a87f3beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:25.471838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c6737-81b4-4f1b-88f8-7867a87f3beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:25.473439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c6737-81b4-4f1b-88f8-7867a87f3beb service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:25.482589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 767/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:29.507271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0251d-607a-4ce2-8a89-38a4cf7cb8eb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:29.508010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0251d-607a-4ce2-8a89-38a4cf7cb8eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:29.508614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0251d-607a-4ce2-8a89-38a4cf7cb8eb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:29.510009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:29.515439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612033-bec6-456e-bf9f-0bf010451b0d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:29.515896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612033-bec6-456e-bf9f-0bf010451b0d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:29.516011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612033-bec6-456e-bf9f-0bf010451b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:29.534157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-78612033-bec6-456e-bf9f-0bf010451b0d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:29.535331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-78612033-bec6-456e-bf9f-0bf010451b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:29.543608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:29.580702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0251d-607a-4ce2-8a89-38a4cf7cb8eb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:29.582859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f0b0251d-607a-4ce2-8a89-38a4cf7cb8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:29.640091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0251d-607a-4ce2-8a89-38a4cf7cb8eb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:29.643647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff8e99-d974-4b0e-99e7-92ab575a34aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:29.644316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8e99-d974-4b0e-99e7-92ab575a34aa service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:29.644601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8e99-d974-4b0e-99e7-92ab575a34aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:29.644875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8e99-d974-4b0e-99e7-92ab575a34aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:29.654389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff8e99-d974-4b0e-99e7-92ab575a34aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:29.655810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff8e99-d974-4b0e-99e7-92ab575a34aa service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:29.660729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:16:29.666269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 762/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:31.691929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f55ad-840d-4b7f-a1a4-77b6d5ffaee9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:31.692518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f55ad-840d-4b7f-a1a4-77b6d5ffaee9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:31.692518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f55ad-840d-4b7f-a1a4-77b6d5ffaee9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:31.693927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:31.699106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f08c0-872d-490b-a4b6-b783e333873a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:31.699530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f08c0-872d-490b-a4b6-b783e333873a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:31.699659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f08c0-872d-490b-a4b6-b783e333873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:31.717904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-548f08c0-872d-490b-a4b6-b783e333873a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:31.719151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-548f08c0-872d-490b-a4b6-b783e333873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:31.727881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:31.763664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f55ad-840d-4b7f-a1a4-77b6d5ffaee9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:31.765439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3e2f55ad-840d-4b7f-a1a4-77b6d5ffaee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:31.778778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f55ad-840d-4b7f-a1a4-77b6d5ffaee9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:31.782644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c35ae5-2a42-4d53-92f2-524aa523a719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:31.783287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35ae5-2a42-4d53-92f2-524aa523a719 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:31.783568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35ae5-2a42-4d53-92f2-524aa523a719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:31.783842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35ae5-2a42-4d53-92f2-524aa523a719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:31.793856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c35ae5-2a42-4d53-92f2-524aa523a719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:31.795265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c35ae5-2a42-4d53-92f2-524aa523a719 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:31.805119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 770/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:35.778433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3389-173d-44b5-90d7-607c587f5a73 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:35.778992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3389-173d-44b5-90d7-607c587f5a73 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:35.778992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3389-173d-44b5-90d7-607c587f5a73 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:35.780447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:16:35.785639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01ad1-aad9-4b4d-8dc8-f864d9ef3a24 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:35.786040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01ad1-aad9-4b4d-8dc8-f864d9ef3a24 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:35.786228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01ad1-aad9-4b4d-8dc8-f864d9ef3a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:35.804543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9ce01ad1-aad9-4b4d-8dc8-f864d9ef3a24 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:35.805732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9ce01ad1-aad9-4b4d-8dc8-f864d9ef3a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:35.813814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:36.120084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda3389-173d-44b5-90d7-607c587f5a73 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:36.121789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6fda3389-173d-44b5-90d7-607c587f5a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:36.181713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda3389-173d-44b5-90d7-607c587f5a73 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:36.185287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99998bed-077e-44f3-b324-d0e31b25eeb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:36.186025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998bed-077e-44f3-b324-d0e31b25eeb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:36.186328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998bed-077e-44f3-b324-d0e31b25eeb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:36.186642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998bed-077e-44f3-b324-d0e31b25eeb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:36.196491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99998bed-077e-44f3-b324-d0e31b25eeb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:36.197910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99998bed-077e-44f3-b324-d0e31b25eeb2 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:36.207179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 765/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:38.276271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ff4c-deb0-4228-ba95-d8d7a9b32b5d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:38.276831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ff4c-deb0-4228-ba95-d8d7a9b32b5d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:38.276941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ff4c-deb0-4228-ba95-d8d7a9b32b5d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:38.278364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:16:38.283750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84ef6-65c4-4025-94e6-f559cac9e596 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:38.284336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84ef6-65c4-4025-94e6-f559cac9e596 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:38.284336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84ef6-65c4-4025-94e6-f559cac9e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:38.303173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e7a84ef6-65c4-4025-94e6-f559cac9e596 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:16:38.304408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e7a84ef6-65c4-4025-94e6-f559cac9e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:38.313210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:16:38.616289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ff4c-deb0-4228-ba95-d8d7a9b32b5d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:16:38.617984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0015ff4c-deb0-4228-ba95-d8d7a9b32b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:16:38.632535 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ff4c-deb0-4228-ba95-d8d7a9b32b5d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:16:38.636352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee31b8-2ea1-4c65-827b-fe8f2ed6596c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:16:38.636988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee31b8-2ea1-4c65-827b-fe8f2ed6596c service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:16:38.637269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee31b8-2ea1-4c65-827b-fe8f2ed6596c service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:16:38.637560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee31b8-2ea1-4c65-827b-fe8f2ed6596c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:16:38.646654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee31b8-2ea1-4c65-827b-fe8f2ed6596c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:16:38.648060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee31b8-2ea1-4c65-827b-fe8f2ed6596c service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:16:38.657862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 773/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:16:48.297611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=32 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:16:48.653765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=70 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:08.800854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad56c7-eaf0-4f1c-8482-8fa4b896528a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:08.801980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad56c7-eaf0-4f1c-8482-8fa4b896528a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:08.802485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad56c7-eaf0-4f1c-8482-8fa4b896528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:08.825972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c7ad56c7-eaf0-4f1c-8482-8fa4b896528a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:08.827622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c7ad56c7-eaf0-4f1c-8482-8fa4b896528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:08.848255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 767/1540] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:08.860675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc1d1-2955-4982-9e47-d85cc64dd846 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:08.863784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc1d1-2955-4982-9e47-d85cc64dd846 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:08.863784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc1d1-2955-4982-9e47-d85cc64dd846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:08.893454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8debc1d1-2955-4982-9e47-d85cc64dd846 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:08.895677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8debc1d1-2955-4982-9e47-d85cc64dd846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:08.907643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 774/1541] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:08.912268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad56c7-eaf0-4f1c-8482-8fa4b896528a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:08.931478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad56c7-eaf0-4f1c-8482-8fa4b896528a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:08.942900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:08.943984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:08.944561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:08.945056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:08.946014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:08.946535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:08.948450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:08.963088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 768/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:08.972897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc1d1-2955-4982-9e47-d85cc64dd846 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:08.991118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc1d1-2955-4982-9e47-d85cc64dd846 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.001536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ca001-c158-4924-abad-3db24f366a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.002292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca001-c158-4924-abad-3db24f366a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.002576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca001-c158-4924-abad-3db24f366a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.002855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca001-c158-4924-abad-3db24f366a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.003547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ca001-c158-4924-abad-3db24f366a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.005461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ca001-c158-4924-abad-3db24f366a3f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.155959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 775/1543] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:08 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:09.160467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.172524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c6768-04bf-4295-996b-99e99f9bc2cd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.172891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14245c95-3536-44bf-b20a-1fe49d2c8906 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.174340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14245c95-3536-44bf-b20a-1fe49d2c8906 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.174340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14245c95-3536-44bf-b20a-1fe49d2c8906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.206536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-14245c95-3536-44bf-b20a-1fe49d2c8906 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.207868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-14245c95-3536-44bf-b20a-1fe49d2c8906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.264415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9b455-029c-47fa-a392-96b0c0e18ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.280817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9b455-029c-47fa-a392-96b0c0e18ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.280817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9b455-029c-47fa-a392-96b0c0e18ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.280817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9b455-029c-47fa-a392-96b0c0e18ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.280817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9b455-029c-47fa-a392-96b0c0e18ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.280817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9b455-029c-47fa-a392-96b0c0e18ed2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.348421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 776/1544] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 24 08:18:09.349827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc768-5adf-4d5c-8581-9747a52470a1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.350118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc768-5adf-4d5c-8581-9747a52470a1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.350397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc768-5adf-4d5c-8581-9747a52470a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.390026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2f5bc768-5adf-4d5c-8581-9747a52470a1 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.391235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2f5bc768-5adf-4d5c-8581-9747a52470a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.403509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 777/1545] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.404724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37130b1-1f98-44d1-956f-a230cdb4456b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.405169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37130b1-1f98-44d1-956f-a230cdb4456b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.405292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37130b1-1f98-44d1-956f-a230cdb4456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.427311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d37130b1-1f98-44d1-956f-a230cdb4456b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.429050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d37130b1-1f98-44d1-956f-a230cdb4456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.433449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 769/1546] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:09.436475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494a1c-ea15-488a-90f4-967f838b5bdb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.436859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494a1c-ea15-488a-90f4-967f838b5bdb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.437150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494a1c-ea15-488a-90f4-967f838b5bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.444093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 778/1547] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.444093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75cc47-2ec3-4359-b1c7-d56db0785a90 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.444093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75cc47-2ec3-4359-b1c7-d56db0785a90 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.444093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75cc47-2ec3-4359-b1c7-d56db0785a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.464354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-db494a1c-ea15-488a-90f4-967f838b5bdb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.466389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-db494a1c-ea15-488a-90f4-967f838b5bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.469927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2a75cc47-2ec3-4359-b1c7-d56db0785a90 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.478981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a75cc47-2ec3-4359-b1c7-d56db0785a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.479113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 770/1548] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.479113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419ae3-2619-4e94-b03f-5e64e7a9d806 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.479113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419ae3-2619-4e94-b03f-5e64e7a9d806 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.479113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419ae3-2619-4e94-b03f-5e64e7a9d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.479800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 779/1549] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.480976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b8465-ca7b-4741-a80f-09931578fbde None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.481248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b8465-ca7b-4741-a80f-09931578fbde None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.481518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b8465-ca7b-4741-a80f-09931578fbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.497870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-46419ae3-2619-4e94-b03f-5e64e7a9d806 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.499056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-46419ae3-2619-4e94-b03f-5e64e7a9d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.499532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f44b8465-ca7b-4741-a80f-09931578fbde None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.500735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f44b8465-ca7b-4741-a80f-09931578fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.506916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 771/1550] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.508112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991dadc-0416-4cad-aeea-5a46dfec2e6d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.508425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991dadc-0416-4cad-aeea-5a46dfec2e6d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.508699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991dadc-0416-4cad-aeea-5a46dfec2e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.514623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 780/1551] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.519064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b8465-ca7b-4741-a80f-09931578fbde None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.524832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b8465-ca7b-4741-a80f-09931578fbde None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.530556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6639b90-607f-4b56-a18f-2ee93591780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.531366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6639b90-607f-4b56-a18f-2ee93591780e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.531658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6639b90-607f-4b56-a18f-2ee93591780e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.531829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8991dadc-0416-4cad-aeea-5a46dfec2e6d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.531940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6639b90-607f-4b56-a18f-2ee93591780e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.532692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6639b90-607f-4b56-a18f-2ee93591780e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.533051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8991dadc-0416-4cad-aeea-5a46dfec2e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.534304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6639b90-607f-4b56-a18f-2ee93591780e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.540964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 772/1552] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.544840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 781/1553] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:09.545929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833fa5-cc7d-4170-9575-1b42e93f5f09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.546060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a0918-1796-48cb-97bc-73dcfdbd7051 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.546338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a0918-1796-48cb-97bc-73dcfdbd7051 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.546619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a0918-1796-48cb-97bc-73dcfdbd7051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.547184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833fa5-cc7d-4170-9575-1b42e93f5f09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.547736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833fa5-cc7d-4170-9575-1b42e93f5f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.565154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-245a0918-1796-48cb-97bc-73dcfdbd7051 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.566432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-245a0918-1796-48cb-97bc-73dcfdbd7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.572642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-61833fa5-cc7d-4170-9575-1b42e93f5f09 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.573971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-61833fa5-cc7d-4170-9575-1b42e93f5f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.575566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 782/1554] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.582237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a0918-1796-48cb-97bc-73dcfdbd7051 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.586144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 773/1555] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.587717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cca1-24a6-4ddc-a9ce-1c390c5e5d01 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.590536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cca1-24a6-4ddc-a9ce-1c390c5e5d01 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.590536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cca1-24a6-4ddc-a9ce-1c390c5e5d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.594014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a0918-1796-48cb-97bc-73dcfdbd7051 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.598622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.599285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.599644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.599923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.600688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:09.600996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.602161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING py.warnings [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:18:09.602161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: warnings.warn(msg) Jun 24 08:18:09.602161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: Jun 24 08:18:09.603074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e59c8-fcff-47ad-9253-5321d30b7053 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.609554 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bf15cca1-24a6-4ddc-a9ce-1c390c5e5d01 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.611050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bf15cca1-24a6-4ddc-a9ce-1c390c5e5d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.615372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 783/1556] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:09.616950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52adb-08d1-427c-84ba-698e34be2d51 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.617339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52adb-08d1-427c-84ba-698e34be2d51 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.617717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52adb-08d1-427c-84ba-698e34be2d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.624177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 774/1557] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.625153 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15cca1-24a6-4ddc-a9ce-1c390c5e5d01 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.635054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15cca1-24a6-4ddc-a9ce-1c390c5e5d01 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.638310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d6e52adb-08d1-427c-84ba-698e34be2d51 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.639501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d6e52adb-08d1-427c-84ba-698e34be2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.640271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8f7fd-0e2b-4d1f-9454-e6cbcc230225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.640928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8f7fd-0e2b-4d1f-9454-e6cbcc230225 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.641210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8f7fd-0e2b-4d1f-9454-e6cbcc230225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.641487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8f7fd-0e2b-4d1f-9454-e6cbcc230225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.642216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8f7fd-0e2b-4d1f-9454-e6cbcc230225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:09.642525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8f7fd-0e2b-4d1f-9454-e6cbcc230225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.644122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8f7fd-0e2b-4d1f-9454-e6cbcc230225 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.647591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 784/1558] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.648398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52adb-08d1-427c-84ba-698e34be2d51 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.657429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 775/1559] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:09.658109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52adb-08d1-427c-84ba-698e34be2d51 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.658624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6c04-a7a3-491e-98bf-41aa9d17148e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.658938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6c04-a7a3-491e-98bf-41aa9d17148e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.659228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6c04-a7a3-491e-98bf-41aa9d17148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.664917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1db18-1348-4871-b422-33e910b84e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.665573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1db18-1348-4871-b422-33e910b84e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.665853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1db18-1348-4871-b422-33e910b84e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.666120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1db18-1348-4871-b422-33e910b84e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.666848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1db18-1348-4871-b422-33e910b84e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.669015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1db18-1348-4871-b422-33e910b84e87 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.677829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-aebc6c04-a7a3-491e-98bf-41aa9d17148e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.679248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aebc6c04-a7a3-491e-98bf-41aa9d17148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.682563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 785/1560] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:09.682563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec10d1-3310-48aa-9f67-17c76846bead None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.682563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec10d1-3310-48aa-9f67-17c76846bead None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.682563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec10d1-3310-48aa-9f67-17c76846bead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.690124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 776/1561] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.690926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6c04-a7a3-491e-98bf-41aa9d17148e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.700841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e4ec10d1-3310-48aa-9f67-17c76846bead None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:09.701020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6c04-a7a3-491e-98bf-41aa9d17148e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.702031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e4ec10d1-3310-48aa-9f67-17c76846bead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:09.705534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.706165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.706445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.706719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.707432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:09.707732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.709331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.710389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 786/1562] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:09.711032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec10d1-3310-48aa-9f67-17c76846bead None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.721873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec10d1-3310-48aa-9f67-17c76846bead None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.726510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.727159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.727444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.727720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.730381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 777/1563] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:09.730540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.730636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.730728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.747437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817df901-6cf1-4399-9bc8-a6c167481659 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.752068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.752751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.753032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.753303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.754024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:09.754331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.755943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.768576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 778/1564] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:09.769175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.779707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c45c-6fbb-4ccd-8d0e-87b5cb4e8ac9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.784379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.785027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.785313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.785586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.786307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:09.786612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.788250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.800755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 779/1565] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:09.801519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.811530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed0ff-057d-4bc8-96f9-90565f8093d4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.816276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.816820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.817105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.817388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.818061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.819045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:18:09.819045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:18:09.819045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:18:09.820292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.860600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 787/1566] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:09.861413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.891288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:09.922408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66643bd-33e6-40ea-b30b-648d15448ea7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.927137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.931929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.931929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.932220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 780/1567] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:09.932322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] PATH_INFO: `/v3/projects/14f7d7e0a5614243974c4c44ec466b14/users/f611b3dde95e44c7931445bb3ef1f59a/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.932434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:09.944408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f7d7e0a5614243974c4c44ec466b14, user_id=f611b3dde95e44c7931445bb3ef1f59a, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:09.947075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:09.949070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:09.993150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f658768-3134-4717-92df-6c68f6a9f9ab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:09.997654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:09.998306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:09.998587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:09.998862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:09.999610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:09.999916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.001575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.013235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 781/1568] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:10.014212 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.023367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05b7e0-31cc-4ecb-ac33-3da56c3a7eb9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.028462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.029077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.029360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.029725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.031022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:10.031344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.032950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.045852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 782/1569] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:10.050789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.055964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6e39f-837e-464c-ad0a-339bcbdf9b50 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.060701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.061315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.061598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.061872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.062542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.064448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.090238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 788/1570] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:09 2022] PUT /identity/v3/projects/14f7d7e0a5614243974c4c44ec466b14/users/f611b3dde95e44c7931445bb3ef1f59a/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:10.091150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.151313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 783/1571] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.151313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.151955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7b11-f7d3-481e-82f4-094ef19b4f3b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.209394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.209971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.210254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.210527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.211182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af133b89-87a7-4133-99fe-c34cdb743906 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.211304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.213218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.216684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.217335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.217619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.217899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.218579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.220516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.313749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 789/1572] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.314573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.351740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 784/1573] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/projects => generated 389 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.351740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.360560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:10.376506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c8d06-0e47-4836-80ac-dcaf0868f7db admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.412950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8e0b-72bd-4588-bff8-df217a1627cb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.417617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.418595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.418595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.418874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.419659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.421632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.428617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:10.433276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.434563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.434849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.435126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.435807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.436849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING py.warnings [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:18:10.436849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: warnings.warn(msg) Jun 24 08:18:10.436849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: Jun 24 08:18:10.438094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.629519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 785/1574] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.630484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.640631 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ec0c-c6e6-4234-8edd-cd9c149582e2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.645214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb36716-7a6e-4e3b-9d6e-d7bd53535020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.645831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36716-7a6e-4e3b-9d6e-d7bd53535020 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.646114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36716-7a6e-4e3b-9d6e-d7bd53535020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.646387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb36716-7a6e-4e3b-9d6e-d7bd53535020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.647055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb36716-7a6e-4e3b-9d6e-d7bd53535020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.649023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb36716-7a6e-4e3b-9d6e-d7bd53535020 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.675400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 790/1575] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/users => generated 283 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.675400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.682770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a6cb6-1630-4327-8a3a-1fabdf73caaa admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.688356 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.689002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.689289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.689569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.690306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.692281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.744884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 786/1576] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.747058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19608d-6849-4abf-ac49-c0b250c99433 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.747420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19608d-6849-4abf-ac49-c0b250c99433 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.747731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19608d-6849-4abf-ac49-c0b250c99433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.764770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4d19608d-6849-4abf-ac49-c0b250c99433 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:10.765972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4d19608d-6849-4abf-ac49-c0b250c99433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:10.808068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 791/1577] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.810077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.824992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 787/1578] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:10.825934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19608d-6849-4abf-ac49-c0b250c99433 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.836105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19608d-6849-4abf-ac49-c0b250c99433 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.877867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d66742-c8c2-4fbc-b40e-4fc777391915 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.882579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.883243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.883526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.883804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.884562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.886524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.894655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:10.895333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:10.895621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:10.895895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:10.896645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:10.898760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:10.981133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 792/1579] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:10.982087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:10.991839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb474-c827-4d8a-9de0-eb3e26c62606 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:10.997405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.003926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.003926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.003926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.004259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 788/1580] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:11.004370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.004473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.004552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.009521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a713c29-6e7f-4c43-bc9c-b9223ba0d456 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.014742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.015390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.015670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.015947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.016769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.018362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.028312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 789/1581] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.032636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.038759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fdeda-8c06-4e3c-b246-ab582a6c32b1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.043933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.044594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.044877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.045149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.045849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.047377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.057948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 790/1582] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.062644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.068948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbba90-236b-4263-851c-ea6b935ab07e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.073548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.074203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.074488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.074786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.075459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.077361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.098845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 793/1583] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:10 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:11.098845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.107085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9a45-1b3d-4f56-9dae-a164923173bc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.111730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.112419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.112716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.112986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.113718 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.115627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.160910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 791/1584] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:11 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:11.161879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.181283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:11.216900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c4e66-bee6-4841-9b7e-a137cba2598c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.220518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.221161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.221444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.221724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.231273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.232775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.242287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 792/1585] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:11.247477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.247960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 794/1586] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:11 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:11.249555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.252884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770747-c4de-47b3-bf68-270cf435371f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.257831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.258373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.258663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.258964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.259987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.260304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72580e-4856-43e6-838d-ef1d061e8882 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.261374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.265297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.265979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.266248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.266527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.267258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.268941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.273044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 793/1587] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.273044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.283838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 795/1588] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.283838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.284249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092683c-9df7-4fe6-a5be-c7bbc10d2e37 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.288095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:11.288910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.289565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.289853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.290133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.290880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.292568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.294098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c2555-2131-4422-b5d0-8beccc28ecbb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.298896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.299538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.299816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.300101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.300843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.302466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.303786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 794/1589] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.305360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.313645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 796/1590] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.314470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.319151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f83b71-def4-48fb-a993-47e440cf44eb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.323741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.323944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543016a-2321-41dd-8461-63765903c274 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.324515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.324808 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.325079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.325991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.327626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.328793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.329430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.329720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.329995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.330709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.332297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.341920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 795/1591] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.341920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.347723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 797/1592] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.350327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.353409 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598551b1-3d08-41a5-bd17-5ff64f2affa9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.358292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.358966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.359254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.359532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.360328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.360875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6504aef-5dc1-4134-ba12-2f823049dd3f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.361972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.365768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.366422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.366717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.366972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.367705 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.369433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.374411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 796/1593] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.378126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.383340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 798/1594] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.383340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.391933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8002d1-b299-40b1-a9d3-d70360df4e67 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.392936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caa8bf-4fbc-46ad-ade3-1a36510e4fc6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.397673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.397946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.398817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.398944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.399123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.399255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.399350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] PATH_INFO: `/v3/projects/e79436f86e1e4038a7b0e41cf468bb62/users/5ebbd67cca66411ea52e4b92478564cf/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.399438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.400159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.401942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.414476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 797/1595] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.415399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.421195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79436f86e1e4038a7b0e41cf468bb62, user_id=5ebbd67cca66411ea52e4b92478564cf, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.425598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.426952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cca8b2-927d-4702-901f-06f32693b93a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.432690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.435111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.435413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.435702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] PATH_INFO: `/v3/projects/29cd599b94204b24bb4cc83de1523442/users/2c1b95cfe9cb42b2aa773fd46614df62/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.451899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cd599b94204b24bb4cc83de1523442, user_id=2c1b95cfe9cb42b2aa773fd46614df62, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.452968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:18:11.452968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:18:11.452968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:18:11.454974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.535521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 798/1596] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:11 2022] PUT /identity/v3/projects/29cd599b94204b24bb4cc83de1523442/users/2c1b95cfe9cb42b2aa773fd46614df62/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:11.536363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 799/1597] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:11 2022] PUT /identity/v3/projects/e79436f86e1e4038a7b0e41cf468bb62/users/5ebbd67cca66411ea52e4b92478564cf/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:11.537306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.546464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.619949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264c1b-069c-41ee-87f2-d0f2dc260af9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.620460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.621782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.622156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.622443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.623301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.625449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.635315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f6cf-106d-40b3-88c6-80c6bdd1b283 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.641509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 800/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.641509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.644790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.645588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.645935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.646286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.647086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.648894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.651204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166eca-d2dd-46f4-a13c-e71dd2153977 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.655774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.656485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.656888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.657174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.658257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.659515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.660132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 799/1599] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.663584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.671361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 801/1600] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:11.673120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:11.674659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111f210-62e9-4e37-bcb2-3784b5d03d95 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.679612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bca0c-e0fa-467b-a434-5ab46e560435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.680558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bca0c-e0fa-467b-a434-5ab46e560435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.680963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bca0c-e0fa-467b-a434-5ab46e560435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.681108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bca0c-e0fa-467b-a434-5ab46e560435 admin admin] PATH_INFO: `/v3/projects/dc30155e50104560b2cd8d95f3e534a6/users/b3345cc7b11246358bb1f5babd054e60/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.683492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67630f08-5698-4d2f-af6b-a92b3db5ef31 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:11.689336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:11.690226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.690510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.690827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] PATH_INFO: `/v3/projects/fc2dc40fdc94476cb58569ba6cbe0565/users/f3dc719bbe734070952f939ca59c7761/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.696859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bca0c-e0fa-467b-a434-5ab46e560435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc30155e50104560b2cd8d95f3e534a6, user_id=b3345cc7b11246358bb1f5babd054e60, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.699663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bca0c-e0fa-467b-a434-5ab46e560435 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.707172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2dc40fdc94476cb58569ba6cbe0565, user_id=f3dc719bbe734070952f939ca59c7761, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:11.709904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:11.838481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 800/1601] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:11 2022] PUT /identity/v3/projects/dc30155e50104560b2cd8d95f3e534a6/users/b3345cc7b11246358bb1f5babd054e60/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:11.840114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199b9c0-cb7c-42b3-bc7d-37463e7ff5d1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.840444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199b9c0-cb7c-42b3-bc7d-37463e7ff5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.840900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199b9c0-cb7c-42b3-bc7d-37463e7ff5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.865607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:11.868588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c199b9c0-cb7c-42b3-bc7d-37463e7ff5d1 None None] MFA Rules not processed for user `2c1b95cfe9cb42b2aa773fd46614df62`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:11.869808 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c199b9c0-cb7c-42b3-bc7d-37463e7ff5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:11.934733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 801/1602] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:11.936020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb68bb-69a0-4277-8e3b-3007f5205467 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:11.936352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb68bb-69a0-4277-8e3b-3007f5205467 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:11.936634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb68bb-69a0-4277-8e3b-3007f5205467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:11.952879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f0bb68bb-69a0-4277-8e3b-3007f5205467 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:11.954066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f0bb68bb-69a0-4277-8e3b-3007f5205467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:12.011248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 802/1603] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:11 2022] PUT /identity/v3/projects/fc2dc40fdc94476cb58569ba6cbe0565/users/f3dc719bbe734070952f939ca59c7761/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:12.012486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.020836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 802/1604] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:12.022155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb68bb-69a0-4277-8e3b-3007f5205467 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.035919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb68bb-69a0-4277-8e3b-3007f5205467 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.084624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b2d5-fd83-4013-8dd6-5f5762d4160e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.089259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ec677-f5c6-4254-ae72-db4ba026abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.090687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec677-f5c6-4254-ae72-db4ba026abef admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.090973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec677-f5c6-4254-ae72-db4ba026abef admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.091357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec677-f5c6-4254-ae72-db4ba026abef admin admin] PATH_INFO: `/v3/projects/a14e04756d06417da712e47759853a06/users/633cfb032a0344619f95e72492e85b9c/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.093768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.094651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.094926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.095196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] PATH_INFO: `/v3/projects/e1244423396f45beb9124e6d04e0381b/users/6935dece64c14ab28be74275d43f07ab/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.102203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:12.106796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ec677-f5c6-4254-ae72-db4ba026abef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14e04756d06417da712e47759853a06, user_id=633cfb032a0344619f95e72492e85b9c, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.114785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ec677-f5c6-4254-ae72-db4ba026abef admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:12.114924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1244423396f45beb9124e6d04e0381b, user_id=6935dece64c14ab28be74275d43f07ab, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.114924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:12.276109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 803/1605] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:12 2022] PUT /identity/v3/projects/e1244423396f45beb9124e6d04e0381b/users/6935dece64c14ab28be74275d43f07ab/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:12.276744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 803/1606] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:12 2022] PUT /identity/v3/projects/a14e04756d06417da712e47759853a06/users/633cfb032a0344619f95e72492e85b9c/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:12.277193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.278701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9d326-9912-469a-86c6-2f280cea0b10 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.279088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9d326-9912-469a-86c6-2f280cea0b10 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.279474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9d326-9912-469a-86c6-2f280cea0b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.301845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-34c9d326-9912-469a-86c6-2f280cea0b10 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:12.303058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-34c9d326-9912-469a-86c6-2f280cea0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:12.351591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b736-9731-45b9-bdda-95bc639431aa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.357418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06417-40ba-46ea-8c83-1acf1e1fda27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.358582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06417-40ba-46ea-8c83-1acf1e1fda27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.359063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06417-40ba-46ea-8c83-1acf1e1fda27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.359599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06417-40ba-46ea-8c83-1acf1e1fda27 admin admin] PATH_INFO: `/v3/projects/7dd422cac63a4bc896ebdcfbda74f4c7/users/a5a987f26f564d7dab132508e2de5aed/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.365541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 804/1607] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:12.368673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9d326-9912-469a-86c6-2f280cea0b10 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.377874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9d326-9912-469a-86c6-2f280cea0b10 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.382952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.383613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.383894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.384171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.384926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.387361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:12.388267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06417-40ba-46ea-8c83-1acf1e1fda27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd422cac63a4bc896ebdcfbda74f4c7, user_id=a5a987f26f564d7dab132508e2de5aed, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.391399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06417-40ba-46ea-8c83-1acf1e1fda27 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:12.613306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 804/1608] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:12 2022] PUT /identity/v3/projects/7dd422cac63a4bc896ebdcfbda74f4c7/users/a5a987f26f564d7dab132508e2de5aed/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:12.618054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6a34a-d401-48f7-ac4c-82c760e098f1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.618183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 805/1609] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:12 2022] POST /identity/v3/projects => generated 365 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:12.618285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6a34a-d401-48f7-ac4c-82c760e098f1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.618285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6a34a-d401-48f7-ac4c-82c760e098f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.618478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.648281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6aa6a34a-d401-48f7-ac4c-82c760e098f1 None None] MFA Rules not processed for user `f3dc719bbe734070952f939ca59c7761`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:12.649487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6aa6a34a-d401-48f7-ac4c-82c760e098f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:12.671737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c641-37b4-4865-877c-38eaa83a1018 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.675520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216fc0-9805-4c85-a638-0c3332b4d6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.676167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216fc0-9805-4c85-a638-0c3332b4d6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.676481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216fc0-9805-4c85-a638-0c3332b4d6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.676748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216fc0-9805-4c85-a638-0c3332b4d6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.723681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 805/1610] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:12.725088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:12.731485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987fcdb-9d9e-49ec-9a5d-45f84a1353b7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.731485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987fcdb-9d9e-49ec-9a5d-45f84a1353b7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.731729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987fcdb-9d9e-49ec-9a5d-45f84a1353b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.745307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216fc0-9805-4c85-a638-0c3332b4d6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.747614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216fc0-9805-4c85-a638-0c3332b4d6ca service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:12.752449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6987fcdb-9d9e-49ec-9a5d-45f84a1353b7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:12.753640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6987fcdb-9d9e-49ec-9a5d-45f84a1353b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:12.758063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 806/1611] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:12.760146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf9e9-78dc-4e60-9836-c40b8d44b8b2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.760146 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf9e9-78dc-4e60-9836-c40b8d44b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.761034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf9e9-78dc-4e60-9836-c40b8d44b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.769750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 806/1612] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:12.770383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987fcdb-9d9e-49ec-9a5d-45f84a1353b7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.788394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987fcdb-9d9e-49ec-9a5d-45f84a1353b7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.791348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e8ddf9e9-78dc-4e60-9836-c40b8d44b8b2 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:12.792567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063bbd8-23d4-488d-a1eb-e2d6f11f62f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.792698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e8ddf9e9-78dc-4e60-9836-c40b8d44b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:12.793460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063bbd8-23d4-488d-a1eb-e2d6f11f62f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.794479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063bbd8-23d4-488d-a1eb-e2d6f11f62f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.794479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063bbd8-23d4-488d-a1eb-e2d6f11f62f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.804351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 807/1613] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:12.806194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddf9e9-78dc-4e60-9836-c40b8d44b8b2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.806919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063bbd8-23d4-488d-a1eb-e2d6f11f62f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.812522 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063bbd8-23d4-488d-a1eb-e2d6f11f62f6 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:12.820834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddf9e9-78dc-4e60-9836-c40b8d44b8b2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.824186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 807/1614] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:12.826189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee5bf-82e4-4b0d-84d6-62681e4bc93c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.826469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee5bf-82e4-4b0d-84d6-62681e4bc93c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.826748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee5bf-82e4-4b0d-84d6-62681e4bc93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.828125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.829122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.829745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.830489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.831469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.833699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:12.844859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:12.854944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-18bee5bf-82e4-4b0d-84d6-62681e4bc93c None None] MFA Rules not processed for user `a5a987f26f564d7dab132508e2de5aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:12.856208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-18bee5bf-82e4-4b0d-84d6-62681e4bc93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:12.922833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 808/1615] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:12.923831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bee5bf-82e4-4b0d-84d6-62681e4bc93c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:12.977192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bee5bf-82e4-4b0d-84d6-62681e4bc93c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:12.981507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:12.982226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:12.982508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:12.982784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:12.991018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:12.992482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.001424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 809/1616] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:13.002207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.010410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2e719-0df1-45e9-aee4-5f35cf199f17 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.014925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.015556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.015838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.016115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.022880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 808/1617] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:12 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:13.022880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.060574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.060574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.061565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ce09e-2ac0-4e18-b095-2a24862f3cd8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.061565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.061565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.061565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.061861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.061946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 810/1618] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:13.061946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.062090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.062173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7419a-cd66-4902-b576-4d2a62ac1f24 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.062249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.062336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.062336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.062336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.062336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.062618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.062618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.062766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 809/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:13.062766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.071934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45805bf6-2b47-48db-9b98-a3ed34ab2403 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.078767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.079389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.079641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.079916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.080674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.082302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.099677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 810/1620] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:13.100798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.125916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabe90f-4245-4628-a37b-f795619f4e50 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.138607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.153052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.153052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.153052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] PATH_INFO: `/v3/projects/80ce0df08afa4caca4427dc66d0b0485/users/167ec626fdeb4299b8844d3b1b976eee/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.157822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ce0df08afa4caca4427dc66d0b0485, user_id=167ec626fdeb4299b8844d3b1b976eee, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.160999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.314838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:13.321425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 811/1621] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:13 2022] PUT /identity/v3/projects/80ce0df08afa4caca4427dc66d0b0485/users/167ec626fdeb4299b8844d3b1b976eee/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:18:13.327031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.331196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 811/1622] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:13 2022] POST /identity/v3/projects => generated 381 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:13.332483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.454252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78aac1-786f-44de-a9a1-0c4ae12f35ab admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.464381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.464869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.467285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.467492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.470437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.474530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51a9b0-a569-44d6-b335-637a613e9938 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.474885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.499596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.500709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.501141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.501578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.502556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 812/1623] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:13.503684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.506384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.507242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.528062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da266a0-9912-4137-88d6-42ba839bb286 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.536645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c111a8-2e8b-4d04-b20c-e3c29d594073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.538227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c111a8-2e8b-4d04-b20c-e3c29d594073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.538822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c111a8-2e8b-4d04-b20c-e3c29d594073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.540653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c111a8-2e8b-4d04-b20c-e3c29d594073 admin admin] PATH_INFO: `/v3/projects/80ce0df08afa4caca4427dc66d0b0485/users/167ec626fdeb4299b8844d3b1b976eee/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.543310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c111a8-2e8b-4d04-b20c-e3c29d594073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ce0df08afa4caca4427dc66d0b0485, user_id=167ec626fdeb4299b8844d3b1b976eee, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.546448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c111a8-2e8b-4d04-b20c-e3c29d594073 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.568743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 813/1624] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:13 2022] PUT /identity/v3/projects/80ce0df08afa4caca4427dc66d0b0485/users/167ec626fdeb4299b8844d3b1b976eee/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:13.587183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e3e9c-04fe-49a0-8e7c-55f07a2164cb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.587183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e3e9c-04fe-49a0-8e7c-55f07a2164cb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.587183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e3e9c-04fe-49a0-8e7c-55f07a2164cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.632304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-679e3e9c-04fe-49a0-8e7c-55f07a2164cb None None] MFA Rules not processed for user `167ec626fdeb4299b8844d3b1b976eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:13.633475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-679e3e9c-04fe-49a0-8e7c-55f07a2164cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:13.661628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 812/1625] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:13 2022] POST /identity/v3/users => generated 297 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:13.661628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.676512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24e4d-e1b8-4608-9145-a08fce0ce642 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.764661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.765366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.766012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.766356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.767477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.769867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.787465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 813/1626] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:18:13.791130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.801186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 814/1627] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:13.815117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e3e9c-04fe-49a0-8e7c-55f07a2164cb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.815638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdea3e6-fa65-4c65-8d0e-98aa9b53ecc3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.821044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.822211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.822546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.822831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] PATH_INFO: `/v3/projects/0a5d40d057ca4579958237222dde29de/users/fee192f556a240288e8ec3b8cf544b2a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.836227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:13.841417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5d40d057ca4579958237222dde29de, user_id=fee192f556a240288e8ec3b8cf544b2a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.844365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.891303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e3e9c-04fe-49a0-8e7c-55f07a2164cb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:13.897144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:13.898917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:13.899213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:13.899495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:13.919190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:13.921326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:13.947713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 815/1628] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:13.963633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 814/1629] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:13 2022] PUT /identity/v3/projects/0a5d40d057ca4579958237222dde29de/users/fee192f556a240288e8ec3b8cf544b2a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:13.968162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:13.989630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9052e9-2b9d-48c6-a29a-d5b25e54b892 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:14.067547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c438-481e-4274-8bf5-37fd524adfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:14.068878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c438-481e-4274-8bf5-37fd524adfbd admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:14.069163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c438-481e-4274-8bf5-37fd524adfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:14.069560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c438-481e-4274-8bf5-37fd524adfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:14.070231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c438-481e-4274-8bf5-37fd524adfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:14.071907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c438-481e-4274-8bf5-37fd524adfbd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:14.083494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 816/1630] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:14.087689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:14.099764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc010f77-d718-46dd-a6b6-79cb2a126195 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:14.105036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:14.105956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:14.106238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:14.106513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] PATH_INFO: `/v3/projects/0a5d40d057ca4579958237222dde29de/users/fee192f556a240288e8ec3b8cf544b2a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:14.109435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5d40d057ca4579958237222dde29de, user_id=fee192f556a240288e8ec3b8cf544b2a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:14.112469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:14.126378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 815/1631] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:14 2022] PUT /identity/v3/projects/0a5d40d057ca4579958237222dde29de/users/fee192f556a240288e8ec3b8cf544b2a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:14.138760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbad03-5e32-4b08-b404-1aeb788ce0d8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:14.139258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbad03-5e32-4b08-b404-1aeb788ce0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:14.139619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbad03-5e32-4b08-b404-1aeb788ce0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:14.207149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-97fbad03-5e32-4b08-b404-1aeb788ce0d8 None None] MFA Rules not processed for user `fee192f556a240288e8ec3b8cf544b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:14.221155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-97fbad03-5e32-4b08-b404-1aeb788ce0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:14.347672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 817/1632] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:14.399320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:14.419360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:14.419825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbad03-5e32-4b08-b404-1aeb788ce0d8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:14.487795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1e7aa-03cd-4c27-b294-5be5bbb816eb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:14.493045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:14.494508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:14.495011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:14.495302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:14.517191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:14.522795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:14.567119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 816/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:14.575992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbad03-5e32-4b08-b404-1aeb788ce0d8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:14.587093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:14.587778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:14.589807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:14.590088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:14.699068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:14.702546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:14.713615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 818/1634] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:15.549915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:16.128909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:16.146692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5e4bb-fad9-43d9-8b39-05287425a03f service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:16.158966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee192f556a240288e8ec3b8cf544b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a5d40d057ca4579958237222dde29de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:16.159870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:16.160350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:16.160797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:16.161682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:16.162297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:16.164085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:16.185342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 817/1635] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:16.189351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:16.209255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf52ad-d32b-4340-b25a-15da5eda4b28 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:16.214909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee192f556a240288e8ec3b8cf544b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a5d40d057ca4579958237222dde29de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:16.215856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:16.216322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:16.216764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:16.217679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:16.220254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:16.528832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 819/1636] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:16 2022] POST /identity/v3/projects => generated 355 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:18:16.529787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:16.529787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc95529-629c-48e3-aa83-e5765d7ad182 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:16.529787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489249fc-3877-489f-8738-1616405f9d32 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee192f556a240288e8ec3b8cf544b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a5d40d057ca4579958237222dde29de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:16.530411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489249fc-3877-489f-8738-1616405f9d32 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:16.530411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489249fc-3877-489f-8738-1616405f9d32 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:16.530411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489249fc-3877-489f-8738-1616405f9d32 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:16.530411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489249fc-3877-489f-8738-1616405f9d32 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:16.530411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489249fc-3877-489f-8738-1616405f9d32 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:16.530816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489249fc-3877-489f-8738-1616405f9d32 tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:16.530816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 818/1637] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:16.573791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:16.595280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589dc8d-318b-4106-99ca-38d7c0e1db1f tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:16.601527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee192f556a240288e8ec3b8cf544b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a5d40d057ca4579958237222dde29de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:16.602629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:16.603085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:16.604081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] PATH_INFO: `/v3/projects/bf099477cc704bf0bdb91f7df8dc446c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:16.606269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf099477cc704bf0bdb91f7df8dc446c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:16.607953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: WARNING py.warnings [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:18:16.607953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: warnings.warn(msg) Jun 24 08:18:16.607953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: Jun 24 08:18:16.610138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:16.883552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf099477cc704bf0bdb91f7df8dc446c', 'request_id': 'req-42bc51c3-6579-47d8-b97a-ba6dfc28536d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:17.170836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa1a7-f5dc-40a6-8863-a12b848cc501 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:17.171355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa1a7-f5dc-40a6-8863-a12b848cc501 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:17.172016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa1a7-f5dc-40a6-8863-a12b848cc501 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:17.174495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 819/1638] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 08:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:17.185231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf099477cc704bf0bdb91f7df8dc446c', 'request_id': 'req-42bc51c3-6579-47d8-b97a-ba6dfc28536d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:17.188136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc2ee-2ddd-4ff1-a4ae-d6f6d708d25c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:17.188580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc2ee-2ddd-4ff1-a4ae-d6f6d708d25c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:17.189090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc2ee-2ddd-4ff1-a4ae-d6f6d708d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:17.213693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf099477cc704bf0bdb91f7df8dc446c', 'request_id': 'req-42bc51c3-6579-47d8-b97a-ba6dfc28536d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:17.242960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-575dc2ee-2ddd-4ff1-a4ae-d6f6d708d25c None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:17.252804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-575dc2ee-2ddd-4ff1-a4ae-d6f6d708d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:17.253270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] The token cache is being invalidate because project bf099477cc704bf0bdb91f7df8dc446c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:17.253270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:17.253270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-42bc51c3-6579-47d8-b97a-ba6dfc28536d tempest-VolumeQuotaClassesTest-1823578860 tempest-VolumeQuotaClassesTest-1823578860-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:17.256268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 820/1639] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:16 2022] DELETE /identity/v3/projects/bf099477cc704bf0bdb91f7df8dc446c => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:17.374809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:17.409805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 820/1640] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 08:18:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:17.411098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db5109-9a66-4702-ae67-14986458dc2d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:17.411393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db5109-9a66-4702-ae67-14986458dc2d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:17.411679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db5109-9a66-4702-ae67-14986458dc2d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:17.415645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 821/1641] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 08:18:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:18:17.422034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:17.425507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:17.425507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:17.462624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:17.465353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:17.495543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 821/1642] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:18:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:17.545925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db5109-9a66-4702-ae67-14986458dc2d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:17.545925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e0db5109-9a66-4702-ae67-14986458dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:17.623691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db5109-9a66-4702-ae67-14986458dc2d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:17.628137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6771d3-4282-4e07-bfe5-e132664161a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:17.629595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6771d3-4282-4e07-bfe5-e132664161a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:17.629595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6771d3-4282-4e07-bfe5-e132664161a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:17.629835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6771d3-4282-4e07-bfe5-e132664161a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:17.642357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:17.645017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6771d3-4282-4e07-bfe5-e132664161a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:17.647412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6771d3-4282-4e07-bfe5-e132664161a6 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:17.663679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 822/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:18.868217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:18.869666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:19.038750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa419e4e-1bf4-4e6c-9701-d9b2c4368602 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:19.061418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:19.072043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:19.073622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:19.074123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] PATH_INFO: `/v3/users/a5a987f26f564d7dab132508e2de5aed` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:19.077663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a987f26f564d7dab132508e2de5aed)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:19.078934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: WARNING py.warnings [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:18:19.078934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: warnings.warn(msg) Jun 24 08:18:19.078934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: Jun 24 08:18:19.083221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:19.732470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a987f26f564d7dab132508e2de5aed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:19.784011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a987f26f564d7dab132508e2de5aed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:19.807688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a987f26f564d7dab132508e2de5aed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:19.811235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a987f26f564d7dab132508e2de5aed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:20.004177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a987f26f564d7dab132508e2de5aed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:20.020178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 822/1644] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:18 2022] DELETE /identity/v3/users/a5a987f26f564d7dab132508e2de5aed => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:20.020952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:20.021432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:20.021524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:20.070162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:20.074174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:20.269627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 823/1645] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:20.319284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:20.319284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:20.488446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569460c-4488-4c36-8b8a-1a759b3387ac admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:20.490079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6412f7e-4d33-47b5-8372-779b7b3164b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:20.490754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6412f7e-4d33-47b5-8372-779b7b3164b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:20.491044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6412f7e-4d33-47b5-8372-779b7b3164b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:20.491326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6412f7e-4d33-47b5-8372-779b7b3164b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:20.517347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6412f7e-4d33-47b5-8372-779b7b3164b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:20.527999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6412f7e-4d33-47b5-8372-779b7b3164b9 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:20.543632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 823/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:20.987816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:21.291377 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:21.293955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:21.312092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5dcc-dbf2-48be-818f-04cd291cad9f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:21.330429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:21.331487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:21.331924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:21.332391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] PATH_INFO: `/v3/users/2c1b95cfe9cb42b2aa773fd46614df62` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:21.333812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1b95cfe9cb42b2aa773fd46614df62)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:21.335926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:21.630350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1b95cfe9cb42b2aa773fd46614df62'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:21.647047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1b95cfe9cb42b2aa773fd46614df62'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:21.650647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1b95cfe9cb42b2aa773fd46614df62'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:21.650647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1b95cfe9cb42b2aa773fd46614df62'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:21.697068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-963be711-7533-45d8-b8e8-406895373ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1b95cfe9cb42b2aa773fd46614df62'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:21.807614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 824/1647] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:21 2022] DELETE /identity/v3/users/2c1b95cfe9cb42b2aa773fd46614df62 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:21.812790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:21.813273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:21.813540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:21.845684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:21.847203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:22.031124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 824/1648] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:22.095497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e29c3-2f9d-477a-b1ba-2523d13edbf5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:22.095916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e29c3-2f9d-477a-b1ba-2523d13edbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:22.096088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e29c3-2f9d-477a-b1ba-2523d13edbf5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:22.098150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 825/1649] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 08:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:22.108750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:22.111485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:22.115809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082beed-3dca-4451-aa8e-cc5e0b18d574 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:22.116472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082beed-3dca-4451-aa8e-cc5e0b18d574 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:22.117103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082beed-3dca-4451-aa8e-cc5e0b18d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:22.170144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8082beed-3dca-4451-aa8e-cc5e0b18d574 None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:22.171705 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8082beed-3dca-4451-aa8e-cc5e0b18d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:22.276326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f3a4-37f2-4a52-92c9-1805ec49b6a9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:22.290181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2173a7-3c83-4bc1-9e60-d02ed5b4c1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:22.290872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2173a7-3c83-4bc1-9e60-d02ed5b4c1cf service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:22.291162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2173a7-3c83-4bc1-9e60-d02ed5b4c1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:22.291447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2173a7-3c83-4bc1-9e60-d02ed5b4c1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:22.321210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2173a7-3c83-4bc1-9e60-d02ed5b4c1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:22.323383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2173a7-3c83-4bc1-9e60-d02ed5b4c1cf service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:22.361793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 825/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:22.398540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:22.426356 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 826/1651] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 08:18:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:22.432286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261f3a-45a0-48f9-b693-8e0920ff15b9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:22.432666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261f3a-45a0-48f9-b693-8e0920ff15b9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:22.433021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261f3a-45a0-48f9-b693-8e0920ff15b9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:22.435425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 826/1652] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 08:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:22.442135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:22.442768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:22.443592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:22.486242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:22.487723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:22.505257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 827/1653] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:18:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:22.519969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe261f3a-45a0-48f9-b693-8e0920ff15b9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:22.522692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fe261f3a-45a0-48f9-b693-8e0920ff15b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:22.655805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe261f3a-45a0-48f9-b693-8e0920ff15b9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:22.674071 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:22.677197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:22.677913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:22.678532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:22.709064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:22.711762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:22.771752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 827/1654] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:24.034349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:24.037765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:24.070692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85f11-07a1-48ff-9623-b18f7e3e8244 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:24.087412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:24.089000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:24.089582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:24.092153 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] PATH_INFO: `/v3/projects/7dd422cac63a4bc896ebdcfbda74f4c7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:24.100870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd422cac63a4bc896ebdcfbda74f4c7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:24.104344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:24.333955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd422cac63a4bc896ebdcfbda74f4c7', 'request_id': 'req-90969239-2a8c-433d-aa0f-aeac504577fb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:24.467499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd422cac63a4bc896ebdcfbda74f4c7', 'request_id': 'req-90969239-2a8c-433d-aa0f-aeac504577fb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:24.482635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd422cac63a4bc896ebdcfbda74f4c7', 'request_id': 'req-90969239-2a8c-433d-aa0f-aeac504577fb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:24.521237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] The token cache is being invalidate because project 7dd422cac63a4bc896ebdcfbda74f4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:24.521917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:24.526253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-90969239-2a8c-433d-aa0f-aeac504577fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:24.532085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 828/1655] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:24 2022] DELETE /identity/v3/projects/7dd422cac63a4bc896ebdcfbda74f4c7 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:24.536003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:24.584814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1810c-24d7-4ab7-b62b-184e147c365b service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:24.752729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:24.806786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:24.817044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:24.818909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:24.819299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] PATH_INFO: `/v3/users/fee192f556a240288e8ec3b8cf544b2a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:24.828705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee192f556a240288e8ec3b8cf544b2a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:24.835920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:25.141214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee192f556a240288e8ec3b8cf544b2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:25.192463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee192f556a240288e8ec3b8cf544b2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:25.208823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee192f556a240288e8ec3b8cf544b2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:25.209630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee192f556a240288e8ec3b8cf544b2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:25.314914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee192f556a240288e8ec3b8cf544b2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:25.323704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 828/1656] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:24 2022] DELETE /identity/v3/users/fee192f556a240288e8ec3b8cf544b2a => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:25.897038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c18b6-098e-415f-bad7-13f58557e3e0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:25.899246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c18b6-098e-415f-bad7-13f58557e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:25.899839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c18b6-098e-415f-bad7-13f58557e3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:25.927701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:25.930140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:26.099559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a71c18b6-098e-415f-bad7-13f58557e3e0 None None] MFA Rules not processed for user `f611b3dde95e44c7931445bb3ef1f59a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:26.109428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a71c18b6-098e-415f-bad7-13f58557e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:26.289541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40b01c-da02-49e3-98c2-5d728ca61122 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:26.312638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:26.314056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:26.316507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:26.318038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] PATH_INFO: `/v3/projects/29cd599b94204b24bb4cc83de1523442` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:26.322304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cd599b94204b24bb4cc83de1523442)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:26.347788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:26.412929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 829/1657] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:26.428068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:26.428743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:26.429463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:26.463526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] MFA Rules not processed for user `f611b3dde95e44c7931445bb3ef1f59a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:26.466143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:26.489370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 830/1658] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:26.506870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:26.510487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:26.603964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cd599b94204b24bb4cc83de1523442', 'request_id': 'req-5129d89e-3771-4281-9246-c8365ca71e94'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:26.622089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cd599b94204b24bb4cc83de1523442', 'request_id': 'req-5129d89e-3771-4281-9246-c8365ca71e94'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:26.631501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:26.651244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:26.718140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21850b75-c4db-41ed-94a7-346eff864b22 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:26.765707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cd599b94204b24bb4cc83de1523442', 'request_id': 'req-5129d89e-3771-4281-9246-c8365ca71e94'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:26.797189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] The token cache is being invalidate because project 29cd599b94204b24bb4cc83de1523442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:26.800226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:26.802025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:26.815516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 829/1659] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:25 2022] DELETE /identity/v3/projects/29cd599b94204b24bb4cc83de1523442 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:26.817259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:26.819221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:26.877573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:26.881458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:26.881458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:26.881458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:26.881458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:27.061409 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129d89e-3771-4281-9246-c8365ca71e94 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:27.075320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:27.076247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:27.076530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:27.078896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] PATH_INFO: `/v3/users/167ec626fdeb4299b8844d3b1b976eee` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:27.084439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167ec626fdeb4299b8844d3b1b976eee)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:27.086570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:27.098196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:27.099852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:27.144690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 831/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:27.387894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167ec626fdeb4299b8844d3b1b976eee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:27.414049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167ec626fdeb4299b8844d3b1b976eee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:27.431033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167ec626fdeb4299b8844d3b1b976eee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:27.432004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167ec626fdeb4299b8844d3b1b976eee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:27.587417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f80484ef-fd2b-494f-ab82-37f081d21d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167ec626fdeb4299b8844d3b1b976eee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:27.603012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 830/1661] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:26 2022] DELETE /identity/v3/users/167ec626fdeb4299b8844d3b1b976eee => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:28.594024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:28.595603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:28.616925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5db06-9c18-4ac3-8636-a2f75dd4b401 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:28.768846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:28.770326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:28.770770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:28.771197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] PATH_INFO: `/v3/projects/0a5d40d057ca4579958237222dde29de` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:28.773418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5d40d057ca4579958237222dde29de)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:28.775960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:28.889532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b991b67-7ef6-42c3-9e86-b0a3d03bf4ea None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:28.889989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b991b67-7ef6-42c3-9e86-b0a3d03bf4ea None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:28.890103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b991b67-7ef6-42c3-9e86-b0a3d03bf4ea None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:28.891807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 831/1662] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 08:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:28.905692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5f13-5231-414c-90df-d958ad462657 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:28.908714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5f13-5231-414c-90df-d958ad462657 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:28.908714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5f13-5231-414c-90df-d958ad462657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:28.930574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:28.956362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5d40d057ca4579958237222dde29de', 'request_id': 'req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:29.020443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-906b5f13-5231-414c-90df-d958ad462657 None None] MFA Rules not processed for user `2d8183015eed4fd19e4a5fdf57d341e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:29.022065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-906b5f13-5231-414c-90df-d958ad462657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:29.076508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5d40d057ca4579958237222dde29de', 'request_id': 'req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:29.085427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5d40d057ca4579958237222dde29de', 'request_id': 'req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:29.128266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] The token cache is being invalidate because project 0a5d40d057ca4579958237222dde29de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:29.128266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:29.128266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3d7a871a-6caf-40d9-98c4-16b3b7d1e758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:29.147241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 832/1663] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:28 2022] DELETE /identity/v3/projects/0a5d40d057ca4579958237222dde29de => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:29.152244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3840-0a37-4802-88e4-08d6fdfacf98 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:29.153049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3840-0a37-4802-88e4-08d6fdfacf98 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:29.154960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3840-0a37-4802-88e4-08d6fdfacf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:29.164756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 832/1664] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:18:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:29.194951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b5f13-5231-414c-90df-d958ad462657 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:29.196698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-906b5f13-5231-414c-90df-d958ad462657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:29.215777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b5f13-5231-414c-90df-d958ad462657 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:29.223266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7a796-b9bb-491a-8a5f-ba92ba7024c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:29.225074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7a796-b9bb-491a-8a5f-ba92ba7024c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:29.225354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7a796-b9bb-491a-8a5f-ba92ba7024c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:29.226078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-adea3840-0a37-4802-88e4-08d6fdfacf98 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:29.226783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7a796-b9bb-491a-8a5f-ba92ba7024c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:29.229252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-adea3840-0a37-4802-88e4-08d6fdfacf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:29.243934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:29.245259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7a796-b9bb-491a-8a5f-ba92ba7024c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:29.248248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7a796-b9bb-491a-8a5f-ba92ba7024c7 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:29.287274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 833/1665] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:29.288722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803827-0741-474e-8961-ae33874a6955 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:29.289026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803827-0741-474e-8961-ae33874a6955 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:29.289292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803827-0741-474e-8961-ae33874a6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:29.390114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-98803827-0741-474e-8961-ae33874a6955 None None] MFA Rules not processed for user `633cfb032a0344619f95e72492e85b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:29.391706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-98803827-0741-474e-8961-ae33874a6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:29.521213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 833/1666] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:29.529722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc0b2-69fc-446a-8101-8012200dd082 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:29.530422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc0b2-69fc-446a-8101-8012200dd082 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:29.530793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc0b2-69fc-446a-8101-8012200dd082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:29.588246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 834/1667] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:29.596021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-20afc0b2-69fc-446a-8101-8012200dd082 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:29.596021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-20afc0b2-69fc-446a-8101-8012200dd082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:29.609136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803827-0741-474e-8961-ae33874a6955 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:29.609862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-98803827-0741-474e-8961-ae33874a6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:29.622544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 834/1668] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:29.632976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afc0b2-69fc-446a-8101-8012200dd082 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:29.658926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afc0b2-69fc-446a-8101-8012200dd082 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:29.686266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:29.687944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:29.689838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:29.691935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:29.693567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:29.697886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:29.705720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:29.777220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 835/1669] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:29.780084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:29.807470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b7daa-b4ce-4048-8eab-3b07f4c875b7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:29.826942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0aaa8-54f2-4870-a3e5-55aa80cd37ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:29.827564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0aaa8-54f2-4870-a3e5-55aa80cd37ac admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:29.837259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0aaa8-54f2-4870-a3e5-55aa80cd37ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:29.838106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0aaa8-54f2-4870-a3e5-55aa80cd37ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:29.844541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0aaa8-54f2-4870-a3e5-55aa80cd37ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:29.850196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0aaa8-54f2-4870-a3e5-55aa80cd37ac admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:29.898496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803827-0741-474e-8961-ae33874a6955 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:29.904691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:29.905547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:29.905983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:29.934821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:29.934821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:29.934821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:29.946118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 835/1670] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:30.032040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 836/1671] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:29 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:30.036225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:30.051619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abf73-e0cc-4b6d-ab43-d206112a6457 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:30.211040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:30.211887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:30.212150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:30.212561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:30.213778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:30.226208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:30.367256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83865-de19-433e-9d9a-9e9e6d1e34ff None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:30.372189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83865-de19-433e-9d9a-9e9e6d1e34ff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:30.372189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83865-de19-433e-9d9a-9e9e6d1e34ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:30.403742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 836/1672] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:30 2022] POST /identity/v3/users => generated 294 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:18:30.405778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:30.453571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810d915-1d22-4cfc-bd29-c802fcc9c079 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:30.476847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:30.478188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:30.479831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:30.492807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6ac83865-de19-433e-9d9a-9e9e6d1e34ff None None] MFA Rules not processed for user `b3345cc7b11246358bb1f5babd054e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:30.492807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6ac83865-de19-433e-9d9a-9e9e6d1e34ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:30.493055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:30.493055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:30.493055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:30.538892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 837/1673] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:30.544301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:30.563076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9f23-bcb8-4f81-8dea-21fc69836ff8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:30.578648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:30.578648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:30.578648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:30.578648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:30.579037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:30.580656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:30.611839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 838/1674] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:30.622096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:30.624432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:30.664494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd219d7-0f6b-42ba-a19e-0297e2ade0bc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:30.708992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 837/1675] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:30.708992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83865-de19-433e-9d9a-9e9e6d1e34ff None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:30.714198 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:30.716811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:30.717095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:30.717377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] PATH_INFO: `/v3/projects/80ce0df08afa4caca4427dc66d0b0485` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:30.722374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ce0df08afa4caca4427dc66d0b0485)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:30.724379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:30.737629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83865-de19-433e-9d9a-9e9e6d1e34ff None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:30.765960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:30.766872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:30.770372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:30.770855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] PATH_INFO: `/v3/projects/6802d5ecdfd740e9bcb5d6b71deabd73/users/ed893ac8339b45038752ad3fdcbb48e8/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:30.814200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6802d5ecdfd740e9bcb5d6b71deabd73, user_id=ed893ac8339b45038752ad3fdcbb48e8, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:30.820669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:30.984175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:31.006037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 838/1676] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:30 2022] PUT /identity/v3/projects/6802d5ecdfd740e9bcb5d6b71deabd73/users/ed893ac8339b45038752ad3fdcbb48e8/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:31.007656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:31.032954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ce0df08afa4caca4427dc66d0b0485', 'request_id': 'req-c948424e-33e6-47a2-b8ba-3fa63355d081'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:31.048004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ce0df08afa4caca4427dc66d0b0485', 'request_id': 'req-c948424e-33e6-47a2-b8ba-3fa63355d081'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:31.141585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ce0df08afa4caca4427dc66d0b0485', 'request_id': 'req-c948424e-33e6-47a2-b8ba-3fa63355d081'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:31.164579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] The token cache is being invalidate because project 80ce0df08afa4caca4427dc66d0b0485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:31.165391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:31.167686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c948424e-33e6-47a2-b8ba-3fa63355d081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:31.187139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 839/1677] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:30 2022] DELETE /identity/v3/projects/80ce0df08afa4caca4427dc66d0b0485 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:31.191296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f298-1e63-4c95-a3f8-be6ecbbad121 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:31.193425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405857-7dad-4b6e-88ed-a4c23a6d6ef4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:31.193425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405857-7dad-4b6e-88ed-a4c23a6d6ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:31.197413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405857-7dad-4b6e-88ed-a4c23a6d6ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:31.256086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3a405857-7dad-4b6e-88ed-a4c23a6d6ef4 None None] MFA Rules not processed for user `ed893ac8339b45038752ad3fdcbb48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:31.258654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a405857-7dad-4b6e-88ed-a4c23a6d6ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:31.333755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:31.339015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:31.339541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:31.340492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:31.346037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:31.424412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 840/1678] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:31.426102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f579f-754d-4829-aea4-d7e6dd5ac3be None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:31.426556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f579f-754d-4829-aea4-d7e6dd5ac3be None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:31.426838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f579f-754d-4829-aea4-d7e6dd5ac3be None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:31.432551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 841/1679] 10.222.0.42 () {54 vars in 960 bytes} [Fri Jun 24 08:18:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:31.434059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5ebb-27d3-424f-b201-0b25b6ff367d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:31.434351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5ebb-27d3-424f-b201-0b25b6ff367d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:31.434619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5ebb-27d3-424f-b201-0b25b6ff367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:31.458432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a36d5ebb-27d3-424f-b201-0b25b6ff367d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:31.459676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a36d5ebb-27d3-424f-b201-0b25b6ff367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:31.467351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:31.470072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:31.491590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 839/1680] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:31.493591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:31.495790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:31.587833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 842/1681] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:31.589464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1345cd-180a-491c-833f-fb0b73c1ea67 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:31.589971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1345cd-180a-491c-833f-fb0b73c1ea67 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:31.590613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1345cd-180a-491c-833f-fb0b73c1ea67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:31.624332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9c1345cd-180a-491c-833f-fb0b73c1ea67 None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:31.628351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9c1345cd-180a-491c-833f-fb0b73c1ea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:31.671026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8855f4-994c-4efc-92cd-20b7423e4e00 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:31.689685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:31.691649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:31.692093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:31.692675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:31.694534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:31.704264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:31.805061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 843/1682] 10.222.0.42 () {58 vars in 1057 bytes} [Fri Jun 24 08:18:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:31.807386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcbb34-dbe8-486f-aff6-c10a4a89e64b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:31.807796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcbb34-dbe8-486f-aff6-c10a4a89e64b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:31.808180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcbb34-dbe8-486f-aff6-c10a4a89e64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:31.841703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-04fcbb34-dbe8-486f-aff6-c10a4a89e64b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:31.842720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-04fcbb34-dbe8-486f-aff6-c10a4a89e64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:31.867722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 844/1683] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:31.867722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcbb34-dbe8-486f-aff6-c10a4a89e64b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:31.879132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 840/1684] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:31 2022] POST /identity/v3/projects => generated 389 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:31.882548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:31.894918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcbb34-dbe8-486f-aff6-c10a4a89e64b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:32.012861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2677-d065-4221-963c-24e3f293e18d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:32.020801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:32.021788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:32.022419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:32.022918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:32.023880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:32.025195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:32.027634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:32.054613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:32.055320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:32.055618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:32.055892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:32.063853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 841/1685] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:32.063853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:32.065050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:32.076881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a327e-9a85-4078-a30d-15f43c80673e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:32.083594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:32.084506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:32.084923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:32.085911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:32.087412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:32.088722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:32.090469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:32.090597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:32.123282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 845/1686] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:32.124219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:32.129899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:32.167441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b707-b31c-4908-9218-6fc22b7ed419 service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:32.181155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:32.187628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:32.187628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:32.187628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] PATH_INFO: `/v3/users/f3dc719bbe734070952f939ca59c7761` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:32.187628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3dc719bbe734070952f939ca59c7761)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:32.188564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:32.347015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:32.578707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 842/1687] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:32 2022] POST /identity/v3/users => generated 301 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:32.581439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:32.603889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dcf90-0098-4d8e-a4b2-e568aa7cb362 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:32.610945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:32.611964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:32.612487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:32.613281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:32.614308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:32.617424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:32.827979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 843/1688] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:32 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:32.829372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:32.840043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3dc719bbe734070952f939ca59c7761'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:32.860725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3dc719bbe734070952f939ca59c7761'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:32.876151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3dc719bbe734070952f939ca59c7761'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:32.877283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3dc719bbe734070952f939ca59c7761'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:32.950311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5880eb-ca44-4fd6-be11-71ba62d9e336 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:32.973313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ee3dd-a41e-40bb-9db0-d0e48d12b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:32.974523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee3dd-a41e-40bb-9db0-d0e48d12b6de admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:32.974918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee3dd-a41e-40bb-9db0-d0e48d12b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:32.975300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee3dd-a41e-40bb-9db0-d0e48d12b6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:32.976562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ee3dd-a41e-40bb-9db0-d0e48d12b6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:32.987957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ee3dd-a41e-40bb-9db0-d0e48d12b6de admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:33.022551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3dc719bbe734070952f939ca59c7761'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:33.032778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 846/1689] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:32 2022] DELETE /identity/v3/users/f3dc719bbe734070952f939ca59c7761 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:33.035035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:33.040884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:33.044056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 844/1690] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:33.048596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0895-7628-4d31-8ec3-ab516f37a9c7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.051106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0895-7628-4d31-8ec3-ab516f37a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.051558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0895-7628-4d31-8ec3-ab516f37a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.127945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-69ef0895-7628-4d31-8ec3-ab516f37a9c7 None None] MFA Rules not processed for user `5ebbd67cca66411ea52e4b92478564cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:33.129895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-69ef0895-7628-4d31-8ec3-ab516f37a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:33.182016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb8b6-c493-4a5a-82b8-673bd9ef4863 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:33.191897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fb1c8-013a-47d4-8379-b7a017ed27bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:33.193377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb1c8-013a-47d4-8379-b7a017ed27bc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.193795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb1c8-013a-47d4-8379-b7a017ed27bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.194160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb1c8-013a-47d4-8379-b7a017ed27bc admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.194975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fb1c8-013a-47d4-8379-b7a017ed27bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:33.212620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fb1c8-013a-47d4-8379-b7a017ed27bc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:33.338066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 845/1691] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:33.339995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd54de-a408-4f14-ae04-6356768ed805 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.341167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd54de-a408-4f14-ae04-6356768ed805 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.341669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd54de-a408-4f14-ae04-6356768ed805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.425028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6afd54de-a408-4f14-ae04-6356768ed805 None None] MFA Rules not processed for user `6935dece64c14ab28be74275d43f07ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:33.426506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6afd54de-a408-4f14-ae04-6356768ed805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:33.450559 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 847/1692] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:33 2022] POST /identity/v3/users => generated 284 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:33.452717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.453272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.454636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.499055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:33.503204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:33.524575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 848/1693] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:33.525824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:33.531876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:33.551856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dad97-8314-44e1-8e94-77d2497b16af None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:33.568408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:33.569494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.569882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.570268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] PATH_INFO: `/v3/projects/abc216cca63840748a9c1673592d0921/users/7323762d4acd431da29b23acd1b497a6/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.603160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc216cca63840748a9c1673592d0921, user_id=7323762d4acd431da29b23acd1b497a6, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:33.609851 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 846/1694] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:33.611165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:33.615516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8276f-f555-4462-8938-35bcd0eb06e1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.615810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8276f-f555-4462-8938-35bcd0eb06e1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.616086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8276f-f555-4462-8938-35bcd0eb06e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.681596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0ee8276f-f555-4462-8938-35bcd0eb06e1 None None] MFA Rules not processed for user `5ebbd67cca66411ea52e4b92478564cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:33.687281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0ee8276f-f555-4462-8938-35bcd0eb06e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:33.716109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 847/1695] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:33.717281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8276f-f555-4462-8938-35bcd0eb06e1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:33.737154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 849/1696] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:33 2022] PUT /identity/v3/projects/abc216cca63840748a9c1673592d0921/users/7323762d4acd431da29b23acd1b497a6/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:33.739529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:33.745582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:33.769316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8276f-f555-4462-8938-35bcd0eb06e1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:33.939426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bf07-086a-42af-bb85-839e06f5d533 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:33.945403 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:33.946206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.946425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.946697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.960101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:33.961501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:33.962012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:33.962586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:33.963551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:33.966058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:33.978780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:33.983414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:34.004016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 848/1697] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:34.008760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:34.015370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 850/1698] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:34.017595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:34.020288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:34.040950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:34.214012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b14808-8391-463f-b9a8-8ab35969780b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:34.231578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:34.232602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:34.232957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:34.233864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:34.271480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e530d-1a9f-43a3-a2c6-5974dbb47ecf service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:34.288179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:34.289203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:34.289798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:34.290226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:34.366670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:34.368766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:34.377084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:34.377084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:34.399789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 851/1699] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:34.401223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:34.423851 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:34.433559 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaee3c-f3ea-4a02-b99b-83af59e6a9c5 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:34.441456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 849/1700] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:34.446837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:34.447546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:34.447828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:34.448265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:34.448656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:34.460733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:34.466764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:34.471117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92f2f7-690d-416a-b782-f0c1fb9ca13d service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:34.492183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 852/1701] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:34.498600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:34.541005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:34.541797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:34.542042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:34.542207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:34.542939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:34.545208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46357eb0-8f5b-46cb-9fc4-05f92d3c0b4c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:34.550759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:34.554833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014523f4-2320-4dbb-be7f-fba6f64bd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:34.557732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014523f4-2320-4dbb-be7f-fba6f64bd39b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:34.558206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014523f4-2320-4dbb-be7f-fba6f64bd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:34.559807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014523f4-2320-4dbb-be7f-fba6f64bd39b admin admin] PATH_INFO: `/v3/projects/abc216cca63840748a9c1673592d0921/users/7323762d4acd431da29b23acd1b497a6/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:34.566827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014523f4-2320-4dbb-be7f-fba6f64bd39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc216cca63840748a9c1673592d0921, user_id=7323762d4acd431da29b23acd1b497a6, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:34.579161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014523f4-2320-4dbb-be7f-fba6f64bd39b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:34.585666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 850/1702] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:34.586588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:34.614027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d1f19-2383-4352-9718-a67919acbe19 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:34.614434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 853/1703] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:34 2022] PUT /identity/v3/projects/abc216cca63840748a9c1673592d0921/users/7323762d4acd431da29b23acd1b497a6/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:34.641269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:34.641269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:34.641498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:34.710864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] MFA Rules not processed for user `7323762d4acd431da29b23acd1b497a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:34.717606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:34.873983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dc254-4afb-44d7-905d-7bfb5fd0d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:34.875079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc254-4afb-44d7-905d-7bfb5fd0d31c admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:34.875515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc254-4afb-44d7-905d-7bfb5fd0d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:34.875928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc254-4afb-44d7-905d-7bfb5fd0d31c admin admin] PATH_INFO: `/v3/projects/8c4c529939af44bab2408753b6ef2e74/users/cbe2c307bb76453bacb6996eabde2e8e/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:34.882513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:34.926406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dc254-4afb-44d7-905d-7bfb5fd0d31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4c529939af44bab2408753b6ef2e74, user_id=cbe2c307bb76453bacb6996eabde2e8e, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:34.932094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dc254-4afb-44d7-905d-7bfb5fd0d31c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:34.969161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 854/1704] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:34.978557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:34.980223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:35.042424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 851/1705] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:34 2022] PUT /identity/v3/projects/8c4c529939af44bab2408753b6ef2e74/users/cbe2c307bb76453bacb6996eabde2e8e/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:35.053509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aedd1-42a4-4121-8510-ab41f3f9f948 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:35.054060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aedd1-42a4-4121-8510-ab41f3f9f948 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:35.054796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aedd1-42a4-4121-8510-ab41f3f9f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:35.094336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627321d6-23f8-425b-8993-ba1989690d59 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:35.116707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-016aedd1-42a4-4121-8510-ab41f3f9f948 None None] MFA Rules not processed for user `cbe2c307bb76453bacb6996eabde2e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:35.118006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-016aedd1-42a4-4121-8510-ab41f3f9f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:35.244386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:35.246106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:35.246513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:35.247539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:35.316220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 852/1706] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:35.321261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aedd1-42a4-4121-8510-ab41f3f9f948 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:35.366840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:35.373105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:35.449591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 855/1707] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:35.480800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aedd1-42a4-4121-8510-ab41f3f9f948 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:35.490630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:35.491462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:35.491867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:35.492025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:35.497792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:35.503782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:35.642225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 853/1708] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:35 2022] POST /identity/v3/projects => generated 367 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:35.645604 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:35.664429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2c19-4e06-4554-9d14-5ed7f6cf713f service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:35.687126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:35.847432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6e0ab-fbf3-4278-97f8-f5fb7de3c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:35.854490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6e0ab-fbf3-4278-97f8-f5fb7de3c6de admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:35.854490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6e0ab-fbf3-4278-97f8-f5fb7de3c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:35.854490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6e0ab-fbf3-4278-97f8-f5fb7de3c6de admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:35.854490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6e0ab-fbf3-4278-97f8-f5fb7de3c6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:35.854490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6e0ab-fbf3-4278-97f8-f5fb7de3c6de admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:35.871962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e59074-0ff0-4de6-b324-0241896f870a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:35.877354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:35.878349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:35.878581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:35.879165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] PATH_INFO: `/v3/users/ed893ac8339b45038752ad3fdcbb48e8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:35.880835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed893ac8339b45038752ad3fdcbb48e8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:35.887111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:36.016285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 856/1709] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:35 2022] POST /identity/v3/users => generated 290 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:36.018658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756cb2-7f85-4cc9-8a3f-7f187c9023cb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.023021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756cb2-7f85-4cc9-8a3f-7f187c9023cb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.024641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756cb2-7f85-4cc9-8a3f-7f187c9023cb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.029287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 857/1710] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 08:18:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:36.032806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a756cb2-7f85-4cc9-8a3f-7f187c9023cb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:36.036854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a756cb2-7f85-4cc9-8a3f-7f187c9023cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.080929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a756cb2-7f85-4cc9-8a3f-7f187c9023cb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:36.099462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:36.101215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.104894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.104894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] PATH_INFO: `/v3/projects/fc2dc40fdc94476cb58569ba6cbe0565` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.107082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2dc40fdc94476cb58569ba6cbe0565)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:36.109843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:36.233683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed893ac8339b45038752ad3fdcbb48e8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.250635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed893ac8339b45038752ad3fdcbb48e8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.251965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed893ac8339b45038752ad3fdcbb48e8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.253061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed893ac8339b45038752ad3fdcbb48e8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.281397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2dc40fdc94476cb58569ba6cbe0565', 'request_id': 'req-170c2f7a-bcec-4523-914e-f6f9970f6c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.285649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed893ac8339b45038752ad3fdcbb48e8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.296047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2dc40fdc94476cb58569ba6cbe0565', 'request_id': 'req-170c2f7a-bcec-4523-914e-f6f9970f6c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.421687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 854/1711] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:35 2022] DELETE /identity/v3/users/ed893ac8339b45038752ad3fdcbb48e8 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:18:36.424085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:36.425962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.505072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2dc40fdc94476cb58569ba6cbe0565', 'request_id': 'req-170c2f7a-bcec-4523-914e-f6f9970f6c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.505619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:36.530207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] The token cache is being invalidate because project fc2dc40fdc94476cb58569ba6cbe0565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:36.531714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.532767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-170c2f7a-bcec-4523-914e-f6f9970f6c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:36.538232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 858/1712] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:36 2022] DELETE /identity/v3/projects/fc2dc40fdc94476cb58569ba6cbe0565 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:36.545599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.547688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.548272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.569157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264116a-fd79-4a7f-8ac8-c4a159437fc2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:36.587728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab163-8c34-488e-9a17-5daf6d152c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:36.589184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab163-8c34-488e-9a17-5daf6d152c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.589184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab163-8c34-488e-9a17-5daf6d152c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.589184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab163-8c34-488e-9a17-5daf6d152c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.593163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ab163-8c34-488e-9a17-5daf6d152c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:36.595825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ab163-8c34-488e-9a17-5daf6d152c27 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:36.597916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] MFA Rules not processed for user `2d8183015eed4fd19e4a5fdf57d341e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:36.602793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.622565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 855/1713] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:36.626762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86508cd-8825-47c8-8816-d74e3d5bcf7f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.627171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86508cd-8825-47c8-8816-d74e3d5bcf7f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.627547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86508cd-8825-47c8-8816-d74e3d5bcf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.707828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f86508cd-8825-47c8-8816-d74e3d5bcf7f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:36.713867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f86508cd-8825-47c8-8816-d74e3d5bcf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.742708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 856/1714] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:36.744287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.744697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.745113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.780521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 859/1715] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:36.781312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:36.799334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:36.801214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.815117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.831853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce56d7-9588-4526-8196-8101f5d73bda None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:36.834507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 857/1716] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:36.844933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26917bf3-af42-4c4b-a07b-13a95a0cf890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:36.844933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917bf3-af42-4c4b-a07b-13a95a0cf890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.845118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:36.845192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917bf3-af42-4c4b-a07b-13a95a0cf890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.845192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917bf3-af42-4c4b-a07b-13a95a0cf890 admin admin] PATH_INFO: `/v3/projects/c76432133f8a4dacb1b9d9f2b1fe636b/users/3c91bbb862254430b829f09a6733d1ab/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.848453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.870111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26917bf3-af42-4c4b-a07b-13a95a0cf890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76432133f8a4dacb1b9d9f2b1fe636b, user_id=3c91bbb862254430b829f09a6733d1ab, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:36.873680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26917bf3-af42-4c4b-a07b-13a95a0cf890 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:36.890799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd0aba-9cd7-401c-abe6-5eb3521df449 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:36.901590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:36.902267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.903068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.903347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.927227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:36.928738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:36.957423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 858/1717] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:36.958735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:36.961294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:36.965673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 860/1718] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:36 2022] PUT /identity/v3/projects/c76432133f8a4dacb1b9d9f2b1fe636b/users/3c91bbb862254430b829f09a6733d1ab/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:36.965673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276efb13-7074-482c-aa67-9125d033932e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:36.965673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276efb13-7074-482c-aa67-9125d033932e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:36.967243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276efb13-7074-482c-aa67-9125d033932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:36.983297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878b8aa-5ab7-4210-a536-31c97d60ea38 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:36.992418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-276efb13-7074-482c-aa67-9125d033932e None None] MFA Rules not processed for user `633cfb032a0344619f95e72492e85b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:36.993617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-276efb13-7074-482c-aa67-9125d033932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:37.047532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:37.049390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.049684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.049967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.073583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:37.076104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:37.081490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 861/1719] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:37.083498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c692-024b-481f-9dd1-4fd8adc65589 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.083933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c692-024b-481f-9dd1-4fd8adc65589 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.084391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c692-024b-481f-9dd1-4fd8adc65589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.092877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 859/1720] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:37.098062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:37.154827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d4f8c692-024b-481f-9dd1-4fd8adc65589 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:37.158645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d4f8c692-024b-481f-9dd1-4fd8adc65589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:37.359827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 862/1721] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:37.364835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8c692-024b-481f-9dd1-4fd8adc65589 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:37.390769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8c692-024b-481f-9dd1-4fd8adc65589 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:37.401493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:37.403468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.406475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.406784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.407615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:37.407928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:37.413046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:37.448557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 863/1722] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:37.451813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:37.486064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74372a0c-6db6-4fab-898b-15909c0fb336 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:37.497500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:37.499868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.500168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.501852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.502574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:37.507738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:37.509243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb589db7-20ff-4a88-b97c-43693f257882 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:37.519721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:37.527222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.527222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.527222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.527222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:37.527222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:37.550646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 860/1723] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:37.555538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:37.572562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fb41a-cd46-49f3-b11d-1ebd088bf1eb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:37.579950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef62ba-a628-4186-b3d2-07716dfe7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:37.579950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef62ba-a628-4186-b3d2-07716dfe7c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.579950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef62ba-a628-4186-b3d2-07716dfe7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.579950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef62ba-a628-4186-b3d2-07716dfe7c06 admin admin] PATH_INFO: `/v3/projects/c76432133f8a4dacb1b9d9f2b1fe636b/users/3c91bbb862254430b829f09a6733d1ab/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.582082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef62ba-a628-4186-b3d2-07716dfe7c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76432133f8a4dacb1b9d9f2b1fe636b, user_id=3c91bbb862254430b829f09a6733d1ab, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:37.586938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef62ba-a628-4186-b3d2-07716dfe7c06 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:37.612755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 861/1724] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:37 2022] PUT /identity/v3/projects/c76432133f8a4dacb1b9d9f2b1fe636b/users/3c91bbb862254430b829f09a6733d1ab/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:37.615054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.615347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.615623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.659520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 864/1725] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:37 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:37.661094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:37.694353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] MFA Rules not processed for user `3c91bbb862254430b829f09a6733d1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:37.695855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:37.808302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9afd34-edff-45b6-a7a5-a1d0c8f25611 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:37.826958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:37.828330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:37.828668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:37.829504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:37.832012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:37.836309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:37.868242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 862/1726] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:37.879370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:37.881785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:37.969103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 865/1727] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:37 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:18:37.973500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:38.035719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376be602-ed3b-4861-913f-b6afb2387134 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:38.038689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:38.042784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:38.043621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:38.044089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:38.051369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:38.053119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:38.066949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:38.106381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 866/1728] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:38.107968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:38.115865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100e678-1ad4-4132-b84d-911b717d42ce None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:38.130819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d454ea0-b559-4166-9a0f-afc46cf50367 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:38.133180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:38.142582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:38.142886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:38.143174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:38.163432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ad670-5f7e-4d4a-bb1d-8e6aa4e9c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:38.164130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ad670-5f7e-4d4a-bb1d-8e6aa4e9c6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:38.164448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ad670-5f7e-4d4a-bb1d-8e6aa4e9c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:38.196442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ad670-5f7e-4d4a-bb1d-8e6aa4e9c6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:38.196442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ad670-5f7e-4d4a-bb1d-8e6aa4e9c6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:38.196763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:38.196886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ad670-5f7e-4d4a-bb1d-8e6aa4e9c6a3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:38.199011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:38.237450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 863/1729] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:38.255142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 867/1730] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:38.256237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:38.292698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51d19-a8f5-463b-916b-472ab58533d2 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:38.305518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127a81a-32dc-47ac-b38c-df33df549381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:38.307415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a81a-32dc-47ac-b38c-df33df549381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:38.307745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a81a-32dc-47ac-b38c-df33df549381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:38.308031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a81a-32dc-47ac-b38c-df33df549381 admin admin] PATH_INFO: `/v3/projects/6987df9719eb41dba9c592a1a2c461fd/users/e16bf15606954d4c8e49ab55cf85ed6c/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:38.335601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127a81a-32dc-47ac-b38c-df33df549381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6987df9719eb41dba9c592a1a2c461fd, user_id=e16bf15606954d4c8e49ab55cf85ed6c, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:38.335601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127a81a-32dc-47ac-b38c-df33df549381 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:38.335813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132009-1f1d-4b8f-bb3b-a8a90f1d36dd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:38.335813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132009-1f1d-4b8f-bb3b-a8a90f1d36dd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:38.335813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132009-1f1d-4b8f-bb3b-a8a90f1d36dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:38.379927 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-21132009-1f1d-4b8f-bb3b-a8a90f1d36dd None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:38.381396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-21132009-1f1d-4b8f-bb3b-a8a90f1d36dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:38.535603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 868/1731] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:18:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:38.711374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 864/1732] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:38 2022] PUT /identity/v3/projects/6987df9719eb41dba9c592a1a2c461fd/users/e16bf15606954d4c8e49ab55cf85ed6c/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:18:38.724534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:38.725017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:38.726193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:38.739547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:38.740186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:38.740649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:38.773868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] MFA Rules not processed for user `b3345cc7b11246358bb1f5babd054e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:38.778273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:38.788869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:38.794330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:38.924926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:38.958984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 865/1733] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:38.960299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:38.961822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:38.962316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 869/1734] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:38.963872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:38.971379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:39.021964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05980a24-d772-45ee-a6d8-46a49beff5f6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:39.037571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:39.038554 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:39.038886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:39.039208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] PATH_INFO: `/v3/projects/6802d5ecdfd740e9bcb5d6b71deabd73` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:39.044337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6802d5ecdfd740e9bcb5d6b71deabd73)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:39.046405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:39.086003 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc679b-fedd-4637-9d16-18ad747f59ef None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:39.092427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:39.093243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:39.093623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:39.093993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:39.097866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:39.253515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:39.254975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:39.266321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 866/1735] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:39.267428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:39.363674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c88c4-7bcd-4bb7-9686-a703526abdb6 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:39.423970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6802d5ecdfd740e9bcb5d6b71deabd73', 'request_id': 'req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:39.451744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6802d5ecdfd740e9bcb5d6b71deabd73', 'request_id': 'req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:39.482301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:39.485631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:39.485631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:39.485631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:39.575578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6802d5ecdfd740e9bcb5d6b71deabd73', 'request_id': 'req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:39.634197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] The token cache is being invalidate because project 6802d5ecdfd740e9bcb5d6b71deabd73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:39.634560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:39.643527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:39.661886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 870/1736] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:38 2022] DELETE /identity/v3/projects/6802d5ecdfd740e9bcb5d6b71deabd73 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:39.663412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:39.666376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:39.753086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:39.769253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:39.770863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:39.792415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 867/1737] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:39.794410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:39.821258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb556-7d80-447d-bc89-b12b024f3cab service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:39.836921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:39.837968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:39.838772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:39.839207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] PATH_INFO: `/v3/users/7323762d4acd431da29b23acd1b497a6` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:39.842341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7323762d4acd431da29b23acd1b497a6)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:39.845691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:39.866865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88fbc-1ed1-4aa7-96ca-4c1ee2373001 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:39.885348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f2e6-1adf-4e5c-89ff-d117982faa1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:39.889001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f2e6-1adf-4e5c-89ff-d117982faa1b service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:39.891406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f2e6-1adf-4e5c-89ff-d117982faa1b service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:39.892804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f2e6-1adf-4e5c-89ff-d117982faa1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:39.898959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4883f2e6-1adf-4e5c-89ff-d117982faa1b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:40.123551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f2e6-1adf-4e5c-89ff-d117982faa1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:40.125406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f2e6-1adf-4e5c-89ff-d117982faa1b service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:40.159103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 871/1738] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:18:40.298066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7323762d4acd431da29b23acd1b497a6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:40.358031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:40.360787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7323762d4acd431da29b23acd1b497a6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:40.362067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7323762d4acd431da29b23acd1b497a6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:40.363399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7323762d4acd431da29b23acd1b497a6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:40.451026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fdd73fb8-fdc0-4bc2-8de0-2af04864b04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7323762d4acd431da29b23acd1b497a6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:40.596223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 868/1739] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:39 2022] DELETE /identity/v3/users/7323762d4acd431da29b23acd1b497a6 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:40.745682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:40.746262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:40.746457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:40.818907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] MFA Rules not processed for user `6935dece64c14ab28be74275d43f07ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:40.820130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:40.834510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ddd5-2276-44f5-bac6-8a5e3191deaa None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:40.835011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ddd5-2276-44f5-bac6-8a5e3191deaa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:40.835190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ddd5-2276-44f5-bac6-8a5e3191deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:40.916024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-db11ddd5-2276-44f5-bac6-8a5e3191deaa None None] MFA Rules not processed for user `5ebbd67cca66411ea52e4b92478564cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:40.920307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-db11ddd5-2276-44f5-bac6-8a5e3191deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:41.030894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 872/1740] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:41.052147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 869/1741] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:41.964915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:41.967122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:42.140157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:42.154551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825981c-ace0-43b2-b6a6-446a5367a0b3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:42.174565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:42.175620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:42.175787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:42.176073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] PATH_INFO: `/v3/projects/abc216cca63840748a9c1673592d0921` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:42.177350 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc216cca63840748a9c1673592d0921)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:42.179962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:42.400814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc216cca63840748a9c1673592d0921', 'request_id': 'req-3270b05c-f348-410f-8819-94a1f812be98'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:42.421097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc216cca63840748a9c1673592d0921', 'request_id': 'req-3270b05c-f348-410f-8819-94a1f812be98'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:42.546476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc216cca63840748a9c1673592d0921', 'request_id': 'req-3270b05c-f348-410f-8819-94a1f812be98'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:42.570405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] The token cache is being invalidate because project abc216cca63840748a9c1673592d0921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:42.570847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:42.572725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3270b05c-f348-410f-8819-94a1f812be98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:42.576185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 873/1742] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:41 2022] DELETE /identity/v3/projects/abc216cca63840748a9c1673592d0921 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:42.580833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ecbd0-965b-4f04-8242-a1494570b9fb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:42.581111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ecbd0-965b-4f04-8242-a1494570b9fb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:42.582297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ecbd0-965b-4f04-8242-a1494570b9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:42.628037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-055ecbd0-965b-4f04-8242-a1494570b9fb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:42.632893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-055ecbd0-965b-4f04-8242-a1494570b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:42.793281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 870/1743] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:42.802124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd25a-ed6a-4b43-9ff8-cc1fc2e74f40 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:42.807748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd25a-ed6a-4b43-9ff8-cc1fc2e74f40 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:42.807748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bd25a-ed6a-4b43-9ff8-cc1fc2e74f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:42.842526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-283bd25a-ed6a-4b43-9ff8-cc1fc2e74f40 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:42.843792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-283bd25a-ed6a-4b43-9ff8-cc1fc2e74f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:42.870527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 874/1744] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:42.872765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ecbd0-965b-4f04-8242-a1494570b9fb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:42.889228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ecbd0-965b-4f04-8242-a1494570b9fb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:42.896750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:42.897910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:42.898399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:42.898832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:42.899760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:42.901259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:42.905637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:42.932290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 871/1745] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:42.937620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bd25a-ed6a-4b43-9ff8-cc1fc2e74f40 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:42.953615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bd25a-ed6a-4b43-9ff8-cc1fc2e74f40 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:42.969092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:42.969682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:42.969963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:42.970245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:42.971045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:42.973314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:43.174796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 875/1746] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:42 2022] POST /identity/v3/projects => generated 407 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:43.176014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:43.189769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a36918-7b49-47b4-bb25-cd9cfd57ae68 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:43.351259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b732bc-ad4f-4f90-9fbc-589cc740d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:43.352140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b732bc-ad4f-4f90-9fbc-589cc740d804 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:43.352529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b732bc-ad4f-4f90-9fbc-589cc740d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:43.354444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b732bc-ad4f-4f90-9fbc-589cc740d804 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:43.357014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b732bc-ad4f-4f90-9fbc-589cc740d804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:43.359349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b732bc-ad4f-4f90-9fbc-589cc740d804 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:43.502332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 872/1747] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:43 2022] POST /identity/v3/users => generated 304 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:43.507161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:43.526682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f34c72-aa39-4082-bab2-dc4cb022fc5f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:43.543818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:43.544903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:43.544903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:43.545143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:43.547227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:43.547377 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:43.547565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:43.549351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:43.554090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:43.571092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 876/1748] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:43.574418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:43.577528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] MFA Rules not processed for user `2d8183015eed4fd19e4a5fdf57d341e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:43.579589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:43.610916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fe803-ae84-47b9-be15-a6667d01ba9f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:43.626625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:43.627577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:43.628068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:43.628521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:43.629609 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:43.631388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:43.663911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 877/1749] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:43.670924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:43.695253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7fab-87f8-4317-9904-998706a52d48 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:43.699759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23537f7-3198-4d70-a346-57a9095730e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:43.700881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23537f7-3198-4d70-a346-57a9095730e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:43.701343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23537f7-3198-4d70-a346-57a9095730e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:43.701879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23537f7-3198-4d70-a346-57a9095730e6 admin admin] PATH_INFO: `/v3/projects/8d0d631ac9b847c0981d5a321fef0d63/users/0e5f6d2488c543d98f379c0af7c31531/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:43.733998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23537f7-3198-4d70-a346-57a9095730e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0d631ac9b847c0981d5a321fef0d63, user_id=0e5f6d2488c543d98f379c0af7c31531, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:43.738021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23537f7-3198-4d70-a346-57a9095730e6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:43.867981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 873/1750] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Jun 24 08:18:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:43.894747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:43.896622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:43.905420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 878/1751] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:43 2022] PUT /identity/v3/projects/8d0d631ac9b847c0981d5a321fef0d63/users/0e5f6d2488c543d98f379c0af7c31531/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:43.915932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0ca4-ccf3-49e8-8843-fafe86c940de None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:43.920546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0ca4-ccf3-49e8-8843-fafe86c940de None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:43.921552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0ca4-ccf3-49e8-8843-fafe86c940de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:43.940365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbe2fb-3a0b-4e53-9fc5-fca4c37e3407 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:44.060473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:44.097975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9d9f0ca4-ccf3-49e8-8843-fafe86c940de None None] MFA Rules not processed for user `0e5f6d2488c543d98f379c0af7c31531`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:44.109247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d9f0ca4-ccf3-49e8-8843-fafe86c940de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:44.282298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:44.286070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:44.287852 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:44.289230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:44.327265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:44.331034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:44.349043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 874/1752] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:44.362956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 879/1753] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:44.367674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:44.533459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721304fc-2e2a-4b27-a804-da3543aba46c service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:44.547776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:44.548629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:44.549024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:44.549407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:44.550240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:44.552378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:44.729428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 875/1754] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:44 2022] POST /identity/v3/projects => generated 407 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:44.734235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0ca4-ccf3-49e8-8843-fafe86c940de None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:44.763400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0ca4-ccf3-49e8-8843-fafe86c940de None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:45.013671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:45.013671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:45.013671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:45.013671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:45.014308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:45.017987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:45.167081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 880/1755] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:44 2022] POST /identity/v3/users => generated 310 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:45.172330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:45.183528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e38de-85f8-4060-973a-82c91d0ead27 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:45.223297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:45.225176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:45.225470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:45.225752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:45.226514 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:45.241596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:45.282248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 876/1756] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:45.286365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:45.310405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f4af2-1e10-49a1-9712-a3ab3cd182a1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:45.316424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523155-ea0f-43f5-a460-95c53256e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:45.318176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523155-ea0f-43f5-a460-95c53256e8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:45.318679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523155-ea0f-43f5-a460-95c53256e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:45.319201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523155-ea0f-43f5-a460-95c53256e8cf admin admin] PATH_INFO: `/v3/projects/f07186ac1acd431bbb27da31452a1f60/users/695b3344e5f245e5b05b1c1601790e05/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:45.338464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:45.376805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523155-ea0f-43f5-a460-95c53256e8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07186ac1acd431bbb27da31452a1f60, user_id=695b3344e5f245e5b05b1c1601790e05, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:45.383491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523155-ea0f-43f5-a460-95c53256e8cf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:45.503415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 881/1757] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:45 2022] PUT /identity/v3/projects/f07186ac1acd431bbb27da31452a1f60/users/695b3344e5f245e5b05b1c1601790e05/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:45.503772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:45.524489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffeee5-2ea5-46e5-a93f-9ac11a555999 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:45.637999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:45.640241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:45.640241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:45.690139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:45.691152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:45.691656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:45.693155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:45.722791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:45.734290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:45.756259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 877/1758] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:18:45.766843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:45.769359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] MFA Rules not processed for user `e16bf15606954d4c8e49ab55cf85ed6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:45.770606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:45.782131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14af9e-d3ca-4b42-b0a2-7961b88fa358 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:45.832227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2067bbd-5ac9-4c62-a43c-b881ba417f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:45.837682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067bbd-5ac9-4c62-a43c-b881ba417f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:45.839699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067bbd-5ac9-4c62-a43c-b881ba417f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:45.841476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067bbd-5ac9-4c62-a43c-b881ba417f5b admin admin] PATH_INFO: `/v3/projects/f07186ac1acd431bbb27da31452a1f60/users/695b3344e5f245e5b05b1c1601790e05/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:45.849834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2067bbd-5ac9-4c62-a43c-b881ba417f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07186ac1acd431bbb27da31452a1f60, user_id=695b3344e5f245e5b05b1c1601790e05, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:45.859405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2067bbd-5ac9-4c62-a43c-b881ba417f5b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:45.896118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 878/1759] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:45 2022] PUT /identity/v3/projects/f07186ac1acd431bbb27da31452a1f60/users/695b3344e5f245e5b05b1c1601790e05/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:45.909680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:45.909966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:45.910468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:45.968163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] MFA Rules not processed for user `695b3344e5f245e5b05b1c1601790e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:45.969607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:46.057820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 882/1760] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:46.059042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:46.062085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:46.094625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73eb6f-e135-4a8f-8e2e-bbf6174bf314 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:46.187646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 879/1761] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:46.198325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:46.201220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:46.230465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:46.232043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:46.235783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:46.244377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:46.244377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:46.244377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:46.345355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4936e0-fddc-458c-aa64-7b536c5f5e05 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:46.357383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:46.358185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:46.358733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:46.359232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:46.375670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:46.379547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:46.380234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 883/1762] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:46 2022] POST /identity/v3/projects => generated 401 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:46.384223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:46.394498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 880/1763] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:46 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:46.548303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51401cb-3b57-4ef4-85b2-1ef0f1922ba7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:46.585094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:46.586002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:46.586468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:46.586693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:46.590651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:46.601642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:46.606443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:46.772765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 884/1764] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:46 2022] POST /identity/v3/users => generated 307 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:46.781212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:46.795849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463c968-dbe2-427f-ad1f-51b7fc4ed881 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:46.811624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:46.816499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:46.817090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:46.820332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:46.821486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:46.823994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:46.863860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 881/1765] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:46.869067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:46.917014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c53e28-e87b-4354-9d0f-1716a766dd6e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:46.935906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:46.936923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:46.937374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:46.938398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] PATH_INFO: `/v3/projects/9862e9ee099c4956ade77aba03e169ff/users/bbd3059e54c34d98a85da0ff5f92a9f7/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:47.016867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9862e9ee099c4956ade77aba03e169ff, user_id=bbd3059e54c34d98a85da0ff5f92a9f7, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:47.020860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:47.202789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 885/1766] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:46 2022] PUT /identity/v3/projects/9862e9ee099c4956ade77aba03e169ff/users/bbd3059e54c34d98a85da0ff5f92a9f7/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:47.206779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:47.230635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04914c3-ebbb-4f60-b547-d01769bb52f2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:47.236489 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:47.469945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfd6d-6d67-40b4-abe3-21f9a27fbef6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:47.478925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:47.479399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:47.479807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:47.480184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:47.536135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:47.536990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:47.537378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:47.537782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:47.540712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:47.552716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:47.590594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 882/1767] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:47.595747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:47.600669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:47.624697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa74bcb-4c07-4cf0-856c-84f0a178e593 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:47.635898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:47.637102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:47.637448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:47.637746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] PATH_INFO: `/v3/users/cbe2c307bb76453bacb6996eabde2e8e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:47.639169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe2c307bb76453bacb6996eabde2e8e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:47.643156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:47.655416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:47.657721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:47.696295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 886/1768] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:47.699504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:47.733130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47dbaa-2175-4950-8585-6037a28396ff service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:47.761640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96041a5-d3b3-4bbc-a9f8-c613f182c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:47.763977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96041a5-d3b3-4bbc-a9f8-c613f182c1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:47.764296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96041a5-d3b3-4bbc-a9f8-c613f182c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:47.764960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96041a5-d3b3-4bbc-a9f8-c613f182c1e3 admin admin] PATH_INFO: `/v3/projects/9862e9ee099c4956ade77aba03e169ff/users/bbd3059e54c34d98a85da0ff5f92a9f7/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:47.772036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96041a5-d3b3-4bbc-a9f8-c613f182c1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9862e9ee099c4956ade77aba03e169ff, user_id=bbd3059e54c34d98a85da0ff5f92a9f7, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:47.782082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96041a5-d3b3-4bbc-a9f8-c613f182c1e3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:47.840983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 887/1769] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:47 2022] PUT /identity/v3/projects/9862e9ee099c4956ade77aba03e169ff/users/bbd3059e54c34d98a85da0ff5f92a9f7/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:47.939451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe2c307bb76453bacb6996eabde2e8e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:47.951892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe2c307bb76453bacb6996eabde2e8e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:47.953603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe2c307bb76453bacb6996eabde2e8e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:47.959727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe2c307bb76453bacb6996eabde2e8e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:47.998084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe2c307bb76453bacb6996eabde2e8e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:48.154781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 883/1770] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:47 2022] DELETE /identity/v3/users/cbe2c307bb76453bacb6996eabde2e8e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:48.160076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db1341-46dd-4402-b7f0-971c9c0bb1aa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:48.162634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db1341-46dd-4402-b7f0-971c9c0bb1aa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:48.162634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db1341-46dd-4402-b7f0-971c9c0bb1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:48.213943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-82db1341-46dd-4402-b7f0-971c9c0bb1aa None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:48.215918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-82db1341-46dd-4402-b7f0-971c9c0bb1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:48.309413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 888/1771] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:48.467623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:48.470461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:48.619288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386647-b278-4827-a434-2f6a4f5d76c9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:48.629934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48787996-7ff7-4f27-9f62-7742edd1ec98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:48.631099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787996-7ff7-4f27-9f62-7742edd1ec98 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:48.631583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787996-7ff7-4f27-9f62-7742edd1ec98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:48.632057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787996-7ff7-4f27-9f62-7742edd1ec98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:48.704387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48787996-7ff7-4f27-9f62-7742edd1ec98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:48.709264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48787996-7ff7-4f27-9f62-7742edd1ec98 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:48.746058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 884/1772] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:48.923009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:49.147281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084baf4a-ac07-4f17-8e7d-628abc9b40d4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:49.147578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084baf4a-ac07-4f17-8e7d-628abc9b40d4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:49.147865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084baf4a-ac07-4f17-8e7d-628abc9b40d4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:49.150822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 889/1773] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:49.187274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:49.187274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:49.187274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:49.241728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:49.248570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:49.432416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 885/1774] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:18:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:49.831573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:50.111127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084baf4a-ac07-4f17-8e7d-628abc9b40d4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:50.115129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-084baf4a-ac07-4f17-8e7d-628abc9b40d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:50.181151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084baf4a-ac07-4f17-8e7d-628abc9b40d4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:50.192252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:50.193300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:50.201807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:50.201807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:50.248467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:50.258806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:50.287800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 890/1775] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:50.809939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:51.750740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:52.366181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:52.367295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:52.369365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:52.393478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d03894-7800-4cfc-9019-662cd91d0c5a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:52.408292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:52.409189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:52.409466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:52.409903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] PATH_INFO: `/v3/projects/8c4c529939af44bab2408753b6ef2e74` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:52.411824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4c529939af44bab2408753b6ef2e74)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:52.414345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:52.534314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4c529939af44bab2408753b6ef2e74', 'request_id': 'req-6e9434fd-a839-4aa3-9e27-70e2ecff3545'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.630576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4c529939af44bab2408753b6ef2e74', 'request_id': 'req-6e9434fd-a839-4aa3-9e27-70e2ecff3545'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.639310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4c529939af44bab2408753b6ef2e74', 'request_id': 'req-6e9434fd-a839-4aa3-9e27-70e2ecff3545'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.650985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] The token cache is being invalidate because project 8c4c529939af44bab2408753b6ef2e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:52.651602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.652570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6e9434fd-a839-4aa3-9e27-70e2ecff3545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.654240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 886/1776] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:52 2022] DELETE /identity/v3/projects/8c4c529939af44bab2408753b6ef2e74 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:52.658620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:52.671550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7638-f776-481c-aa5e-50973df8ebdf service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:52.772432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:52.774204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:52.774690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:52.775122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] PATH_INFO: `/v3/users/3c91bbb862254430b829f09a6733d1ab` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:52.776618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c91bbb862254430b829f09a6733d1ab)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:52.779633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:52.962134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c91bbb862254430b829f09a6733d1ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.978070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c91bbb862254430b829f09a6733d1ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.986778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c91bbb862254430b829f09a6733d1ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:52.987499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c91bbb862254430b829f09a6733d1ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:53.285890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea8f9587-8fca-41ac-8cb1-8405da046cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c91bbb862254430b829f09a6733d1ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:53.296421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 891/1777] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:52 2022] DELETE /identity/v3/users/3c91bbb862254430b829f09a6733d1ab => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:53.341135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f6e8-e63a-49b1-8d6a-12b5dc797e71 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:53.341844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f6e8-e63a-49b1-8d6a-12b5dc797e71 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:53.342131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f6e8-e63a-49b1-8d6a-12b5dc797e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:53.412339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-71f6f6e8-e63a-49b1-8d6a-12b5dc797e71 None None] MFA Rules not processed for user `bbd3059e54c34d98a85da0ff5f92a9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:53.412339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-71f6f6e8-e63a-49b1-8d6a-12b5dc797e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:53.538203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 887/1778] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:53.610291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:53.938520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:53.971305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015748d7-79c6-4a89-b8e6-bb9783fa1820 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:53.971305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015748d7-79c6-4a89-b8e6-bb9783fa1820 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:53.971305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015748d7-79c6-4a89-b8e6-bb9783fa1820 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:53.971305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 892/1779] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:18:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:18:53.985805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:53.986562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:53.987113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.018545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:54.019614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:54.117065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 888/1780] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:54.129799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015748d7-79c6-4a89-b8e6-bb9783fa1820 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:54.131665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-015748d7-79c6-4a89-b8e6-bb9783fa1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:54.151827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015748d7-79c6-4a89-b8e6-bb9783fa1820 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:54.160008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460933e9-5d5f-4244-9959-3ed5f88e1d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:54.161727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460933e9-5d5f-4244-9959-3ed5f88e1d6d service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.162071 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460933e9-5d5f-4244-9959-3ed5f88e1d6d service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.163010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460933e9-5d5f-4244-9959-3ed5f88e1d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.173954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460933e9-5d5f-4244-9959-3ed5f88e1d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:54.175564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460933e9-5d5f-4244-9959-3ed5f88e1d6d service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:54.187407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 893/1781] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:54.318570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:54.320264 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:54.391493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6456b4c-268f-4f21-8bf8-b454c15a9589 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:54.396527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:54.397521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.397823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.398107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] PATH_INFO: `/v3/projects/c76432133f8a4dacb1b9d9f2b1fe636b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.399376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76432133f8a4dacb1b9d9f2b1fe636b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:54.401322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:54.507576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76432133f8a4dacb1b9d9f2b1fe636b', 'request_id': 'req-d1c8787c-9057-4c7c-8776-4f3290d994ec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:54.581654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76432133f8a4dacb1b9d9f2b1fe636b', 'request_id': 'req-d1c8787c-9057-4c7c-8776-4f3290d994ec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:54.589165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76432133f8a4dacb1b9d9f2b1fe636b', 'request_id': 'req-d1c8787c-9057-4c7c-8776-4f3290d994ec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:54.602606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] The token cache is being invalidate because project c76432133f8a4dacb1b9d9f2b1fe636b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:54.602893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:54.603564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d1c8787c-9057-4c7c-8776-4f3290d994ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:54.609828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 889/1782] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:54 2022] DELETE /identity/v3/projects/c76432133f8a4dacb1b9d9f2b1fe636b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:54.611378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e108-eb8a-4ac1-99bf-9bf35f831517 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.611856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e108-eb8a-4ac1-99bf-9bf35f831517 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.612059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e108-eb8a-4ac1-99bf-9bf35f831517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.643546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-73f0e108-eb8a-4ac1-99bf-9bf35f831517 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:54.648106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-73f0e108-eb8a-4ac1-99bf-9bf35f831517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:54.706817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036c6d-087f-4156-a6d1-982db839157d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.707339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036c6d-087f-4156-a6d1-982db839157d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.707787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036c6d-087f-4156-a6d1-982db839157d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.709371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 890/1783] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:18:54.717657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85bf93-fce4-4fca-a57d-fca032c7c4fd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.718157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85bf93-fce4-4fca-a57d-fca032c7c4fd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.718592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85bf93-fce4-4fca-a57d-fca032c7c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.759387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9f85bf93-fce4-4fca-a57d-fca032c7c4fd None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:54.760960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9f85bf93-fce4-4fca-a57d-fca032c7c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:54.768578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 894/1784] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:54.779041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b7699-e313-4d15-aac5-390c3f6d5ece None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.779503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b7699-e313-4d15-aac5-390c3f6d5ece None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.779797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b7699-e313-4d15-aac5-390c3f6d5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.823735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9b1b7699-e313-4d15-aac5-390c3f6d5ece None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:54.825757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9b1b7699-e313-4d15-aac5-390c3f6d5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:54.843131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 895/1785] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:54.861473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b7699-e313-4d15-aac5-390c3f6d5ece None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:54.873018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b7699-e313-4d15-aac5-390c3f6d5ece None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:54.877880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 891/1786] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:18:54.878049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:54.879024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.879456 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.880040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.881088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:18:54.881617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:54.883556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:54.901487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 896/1787] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:18:54.903406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85bf93-fce4-4fca-a57d-fca032c7c4fd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:54.912553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:54.935429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:54.938391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85bf93-fce4-4fca-a57d-fca032c7c4fd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:54.965813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:54.966853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.967196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5e320-02fa-46f8-aee2-1a388bc35f68 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:54.967326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.967563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.968296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:54.970252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:54.979002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:54.982483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:54.982849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:54.983185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:54.994200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:54.996509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:55.012124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 897/1788] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:18:55.108563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 892/1789] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:54 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:55.112668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:55.124948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b713b-1837-43f5-856d-c987aa15519d service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:55.202716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:55.243936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:55.245209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:55.245682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:55.246541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:55.264075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:55.264075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:55.427710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:55.428139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 898/1790] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:55 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:18:55.443686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9eea9-8475-4948-b3ca-e09ff8e8806b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:55.461117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:55.462324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:55.462804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:55.463262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:55.464543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:55.467559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:55.486993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 893/1791] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:55.491325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:55.509609 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648d0b-8d59-44a5-b9ee-cd691fd73255 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:55.534582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c03a5-8d72-4e2d-aa6a-0fb0d504a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:55.535605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c03a5-8d72-4e2d-aa6a-0fb0d504a019 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:55.536334 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c03a5-8d72-4e2d-aa6a-0fb0d504a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:55.537197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c03a5-8d72-4e2d-aa6a-0fb0d504a019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:55.538291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c03a5-8d72-4e2d-aa6a-0fb0d504a019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:55.542987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c03a5-8d72-4e2d-aa6a-0fb0d504a019 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:55.565184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 899/1792] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:18:55.570471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:55.583415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ece6e2-2234-4220-84bb-b44e67c727ad admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:55.590388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:55.594122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:55.594411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:55.595172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] PATH_INFO: `/v3/projects/72934ebf655841748dcb838be44ba70f/users/52fe64ff6d5d4c17aeb36309a4f2d31d/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:55.615931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72934ebf655841748dcb838be44ba70f, user_id=52fe64ff6d5d4c17aeb36309a4f2d31d, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:55.619174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:55.685249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:55.748145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 894/1793] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:55 2022] PUT /identity/v3/projects/72934ebf655841748dcb838be44ba70f/users/52fe64ff6d5d4c17aeb36309a4f2d31d/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:55.759089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06d15e-5e5b-4e7a-b00b-648476c831d4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:55.759462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06d15e-5e5b-4e7a-b00b-648476c831d4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:55.759924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06d15e-5e5b-4e7a-b00b-648476c831d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:55.834725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ac06d15e-5e5b-4e7a-b00b-648476c831d4 None None] MFA Rules not processed for user `52fe64ff6d5d4c17aeb36309a4f2d31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:55.842934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ac06d15e-5e5b-4e7a-b00b-648476c831d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:56.001573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 900/1794] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:56.009736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:56.135326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785077-3279-487a-a87a-07a4bb2fcb53 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:56.144817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:56.146787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:56.147422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:56.147872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:56.148898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:56.151777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:56.316689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 895/1795] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:56 2022] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:56.319524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06d15e-5e5b-4e7a-b00b-648476c831d4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:56.354130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06d15e-5e5b-4e7a-b00b-648476c831d4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:56.422405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:56.489263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:56.500485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:56.501245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:56.503346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:56.504375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:56.509123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:56.655912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 901/1796] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:56 2022] POST /identity/v3/users => generated 294 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:56.656247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:56.673787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192df840-060e-4a02-90cd-4150ca836fa8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:56.679977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:56.681244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:56.681402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:56.681737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:56.682546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:56.684895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:56.723752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 896/1797] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:56.725173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:56.751218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90560d6-8b09-4f49-b95f-30ece4c6d530 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:56.766620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:56.769387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:56.773234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:56.773234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:56.773234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:56.773234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:56.795756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 902/1798] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:56.796567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:56.835519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c559-8fde-409e-9c67-f3e54ea873f3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:56.836313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:56.839586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:56.853833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e318ab-2edc-4126-b7e8-bc25ccf554b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:56.854881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e318ab-2edc-4126-b7e8-bc25ccf554b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:56.855266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e318ab-2edc-4126-b7e8-bc25ccf554b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:56.857127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e318ab-2edc-4126-b7e8-bc25ccf554b1 admin admin] PATH_INFO: `/v3/projects/36db63fe581747529d7b40350d0c44de/users/ad33cc1741c743919c450493f303028c/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:56.869017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2aba-1149-481a-b773-d3d010f984b5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:56.891049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:56.892340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:56.892770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:56.897260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e318ab-2edc-4126-b7e8-bc25ccf554b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36db63fe581747529d7b40350d0c44de, user_id=ad33cc1741c743919c450493f303028c, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:56.897547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] PATH_INFO: `/v3/users/e16bf15606954d4c8e49ab55cf85ed6c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:56.900894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16bf15606954d4c8e49ab55cf85ed6c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:56.902198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e318ab-2edc-4126-b7e8-bc25ccf554b1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:56.907946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:57.045795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 897/1799] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:56 2022] PUT /identity/v3/projects/36db63fe581747529d7b40350d0c44de/users/ad33cc1741c743919c450493f303028c/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:18:57.100638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55e88-8ee6-45fe-9e10-30063050b37a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:57.103941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55e88-8ee6-45fe-9e10-30063050b37a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:57.104287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55e88-8ee6-45fe-9e10-30063050b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:57.156338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e2b55e88-8ee6-45fe-9e10-30063050b37a None None] MFA Rules not processed for user `ad33cc1741c743919c450493f303028c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:57.162641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e2b55e88-8ee6-45fe-9e10-30063050b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:57.268333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 898/1800] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:57.274273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b55e88-8ee6-45fe-9e10-30063050b37a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:57.369152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b55e88-8ee6-45fe-9e10-30063050b37a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:57.369152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:57.369152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:57.369152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:57.369575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:57.369575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:57.369575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:57.862837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16bf15606954d4c8e49ab55cf85ed6c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:57.880791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16bf15606954d4c8e49ab55cf85ed6c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:57.890985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16bf15606954d4c8e49ab55cf85ed6c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:57.891891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16bf15606954d4c8e49ab55cf85ed6c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:58.537621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 899/1801] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:18:57 2022] POST /identity/v3/projects => generated 387 bytes in 1258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:18:58.537621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:58.567779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16bf15606954d4c8e49ab55cf85ed6c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:58.575977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 903/1802] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:56 2022] DELETE /identity/v3/users/e16bf15606954d4c8e49ab55cf85ed6c => generated 0 bytes in 1740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:58.632336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e109c6-01b5-4261-83f7-1293691120e7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:58.808787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:58.809834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:58.810208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:58.810392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:58.815159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:58.821670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:58.935395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 900/1803] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:18:58 2022] POST /identity/v3/users => generated 300 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:18:58.939950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:58.943026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:58.972851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff803f43-8cb9-4163-995e-962f5e49910e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:58.979678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:58.981670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:58.982101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:58.982637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:58.983698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:58.985667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:59.011419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 904/1804] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:18:59.019854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:59.031457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e26e-776b-46f7-98a8-78a9287842a9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:59.046567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:59.047567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:59.047755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:59.048038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] PATH_INFO: `/v3/projects/eb16e122eaba467e9a598ae57a949b77/users/cab7a8f689794e5db062a67abdbd60b9/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:59.049599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:59.051627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:59.068792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720cfc-52c0-4ca4-8f72-38671e7f3de7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:59.078338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:59.080467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:59.080912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:59.081577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] PATH_INFO: `/v3/projects/6987df9719eb41dba9c592a1a2c461fd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:59.083335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6987df9719eb41dba9c592a1a2c461fd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:59.086436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:59.087609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb16e122eaba467e9a598ae57a949b77, user_id=cab7a8f689794e5db062a67abdbd60b9, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:59.090477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:59.229886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 901/1805] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:59 2022] PUT /identity/v3/projects/eb16e122eaba467e9a598ae57a949b77/users/cab7a8f689794e5db062a67abdbd60b9/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:59.236178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:59.289345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:59.315571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6987df9719eb41dba9c592a1a2c461fd', 'request_id': 'req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.331199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6987df9719eb41dba9c592a1a2c461fd', 'request_id': 'req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.379422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871296-de0c-408d-8c36-3353c2d277fd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:59.430678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6987df9719eb41dba9c592a1a2c461fd', 'request_id': 'req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.443975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] The token cache is being invalidate because project 6987df9719eb41dba9c592a1a2c461fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:18:59.444315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.445338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.450781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 905/1806] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:18:59 2022] DELETE /identity/v3/projects/6987df9719eb41dba9c592a1a2c461fd => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:59.452536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:59.454065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:59.471507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:59.472631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:59.474417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:59.474417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:59.474417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:59.476722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:59.490178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 902/1807] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:18:59.496160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:59.498722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:59.517755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed549959-a954-46e5-8359-c2c37abc1418 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:59.525958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8dab7-5843-49af-b77c-52dbd6cf618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:59.528299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8dab7-5843-49af-b77c-52dbd6cf618e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:59.528847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8dab7-5843-49af-b77c-52dbd6cf618e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:59.529144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8dab7-5843-49af-b77c-52dbd6cf618e admin admin] PATH_INFO: `/v3/projects/eb16e122eaba467e9a598ae57a949b77/users/cab7a8f689794e5db062a67abdbd60b9/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:59.532186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8dab7-5843-49af-b77c-52dbd6cf618e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb16e122eaba467e9a598ae57a949b77, user_id=cab7a8f689794e5db062a67abdbd60b9, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:59.535244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8dab7-5843-49af-b77c-52dbd6cf618e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:59.546290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:18:59.546915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0af52-ccb9-41a2-99bf-7a408c4a7486 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:59.553000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 903/1808] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:18:59 2022] PUT /identity/v3/projects/eb16e122eaba467e9a598ae57a949b77/users/cab7a8f689794e5db062a67abdbd60b9/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:18:59.566772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:59.567125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:59.567468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:59.625920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] MFA Rules not processed for user `cab7a8f689794e5db062a67abdbd60b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:18:59.627301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:59.676451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:59.677398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:59.677677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:59.678550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] PATH_INFO: `/v3/users/bbd3059e54c34d98a85da0ff5f92a9f7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:59.680730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd3059e54c34d98a85da0ff5f92a9f7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:59.683633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:59.728463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 904/1809] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:18:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:18:59.736598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:18:59.738049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:18:59.795824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d406c4-cd5a-40e8-8521-b8f7cdbabb29 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:18:59.799496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:18:59.800165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:18:59.800507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:18:59.800789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:18:59.811004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:18:59.816689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:18:59.826141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 905/1810] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:18:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:18:59.897968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd3059e54c34d98a85da0ff5f92a9f7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.947179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd3059e54c34d98a85da0ff5f92a9f7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.969858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd3059e54c34d98a85da0ff5f92a9f7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:18:59.971027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd3059e54c34d98a85da0ff5f92a9f7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:00.075742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d3e6f4a8-9344-481a-a91a-b37fc6dbb845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd3059e54c34d98a85da0ff5f92a9f7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:00.084385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 906/1811] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:18:59 2022] DELETE /identity/v3/users/bbd3059e54c34d98a85da0ff5f92a9f7 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:00.615219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:00.627980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939d1a-14a3-4a2b-a0f7-1f82907ad2bc service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:00.708729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:00.710408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:00.710856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:00.711425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] PATH_INFO: `/v3/projects/9862e9ee099c4956ade77aba03e169ff` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:00.713344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9862e9ee099c4956ade77aba03e169ff)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:00.717414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:00.925742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9862e9ee099c4956ade77aba03e169ff', 'request_id': 'req-21217d3b-8808-4be7-8b30-b9d34d5561c5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.028397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9862e9ee099c4956ade77aba03e169ff', 'request_id': 'req-21217d3b-8808-4be7-8b30-b9d34d5561c5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.044385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9862e9ee099c4956ade77aba03e169ff', 'request_id': 'req-21217d3b-8808-4be7-8b30-b9d34d5561c5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.059740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] The token cache is being invalidate because project 9862e9ee099c4956ade77aba03e169ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:01.060189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.061565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.067073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 906/1812] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:00 2022] DELETE /identity/v3/projects/9862e9ee099c4956ade77aba03e169ff => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:01.068497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1265119-6823-4325-8228-7d8ebe33d99d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.069348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1265119-6823-4325-8228-7d8ebe33d99d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.069938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1265119-6823-4325-8228-7d8ebe33d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.096267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e1265119-6823-4325-8228-7d8ebe33d99d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:01.098008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1265119-6823-4325-8228-7d8ebe33d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.175920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.176356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 907/1813] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:01.181840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.185819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4fde-7eeb-4e88-ba3a-799052059b16 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.186115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4fde-7eeb-4e88-ba3a-799052059b16 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.186394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4fde-7eeb-4e88-ba3a-799052059b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.198591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217d3b-8808-4be7-8b30-b9d34d5561c5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.205197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.218295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.218295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.218295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] PATH_INFO: `/v3/users/0e5f6d2488c543d98f379c0af7c31531` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.218295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5f6d2488c543d98f379c0af7c31531)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:01.219249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d9b4fde-7eeb-4e88-ba3a-799052059b16 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:01.219349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:01.219431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d9b4fde-7eeb-4e88-ba3a-799052059b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.226364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 908/1814] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:01.227003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b4fde-7eeb-4e88-ba3a-799052059b16 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.239008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b4fde-7eeb-4e88-ba3a-799052059b16 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.245294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.246361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.247220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.248106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.249021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:01.249504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:01.251860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:01.276434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 909/1815] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:19:01.281292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.294669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2950b-d4d9-49f1-b48b-e3c5002eba96 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.300658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.301591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.304059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.304059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.304059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:01.306047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:01.411420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 910/1816] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:01 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:01.411420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.412211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.474632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4522-0684-41be-9e34-2b7ff9db3a26 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.481696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.481696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.481696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.481696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.482202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.534830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5f6d2488c543d98f379c0af7c31531'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.543582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5f6d2488c543d98f379c0af7c31531'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.544684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5f6d2488c543d98f379c0af7c31531'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.544891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5f6d2488c543d98f379c0af7c31531'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.548155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:01.549844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:01.561067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 911/1817] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:01.561895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.563817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b241d61-035f-4b44-9100-bd75eaa69508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5f6d2488c543d98f379c0af7c31531'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:01.640803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0b6c-a64d-446f-aa7a-47b3ef58ffc2 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.649332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.650206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.650582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.650866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.653101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:01.658853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:01.665795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 907/1818] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:01 2022] DELETE /identity/v3/users/0e5f6d2488c543d98f379c0af7c31531 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:01.670451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.670741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.671058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.717453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:01.722457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.809467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 912/1819] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:01 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:01.810568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.812432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.840237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b4fb-68c9-49a6-b1c6-e0908d77625d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.843094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 908/1820] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:01.848673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.850125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.850675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.851120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.852019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:01.854210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:01.858803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.860489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:01.893793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 913/1821] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:01.902218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.915661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cf1e8-ac77-4be3-ae8c-60f557654cb5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.923388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.924112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.927701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.927701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.927701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:01.927701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:01.948533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 914/1822] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:01.953657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:01.967455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a76cf-b255-438b-85ee-c4cbede5e582 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.968652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2a5e-b228-4f83-9d42-bb7c69a8d50e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:01.974745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.975743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.979370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.979370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] PATH_INFO: `/v3/projects/2b14c8224fc2479c90255d6533f6e665/users/b2436446f53c405fabcf9df731464f64/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.979750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e00c2e-6f73-407c-9793-e880bc06f216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:01.979750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e00c2e-6f73-407c-9793-e880bc06f216 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:01.979750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e00c2e-6f73-407c-9793-e880bc06f216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:01.979750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e00c2e-6f73-407c-9793-e880bc06f216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:01.994358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b14c8224fc2479c90255d6533f6e665, user_id=b2436446f53c405fabcf9df731464f64, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:02.003259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e00c2e-6f73-407c-9793-e880bc06f216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:02.006277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e00c2e-6f73-407c-9793-e880bc06f216 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:02.022292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:02.031885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 909/1823] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:02.208594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 915/1824] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:01 2022] PUT /identity/v3/projects/2b14c8224fc2479c90255d6533f6e665/users/b2436446f53c405fabcf9df731464f64/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:02.217335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842253a2-5ddd-4504-9ce4-50cb5044967f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:02.217624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842253a2-5ddd-4504-9ce4-50cb5044967f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:02.217911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842253a2-5ddd-4504-9ce4-50cb5044967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:02.239698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:02.252445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-842253a2-5ddd-4504-9ce4-50cb5044967f None None] MFA Rules not processed for user `b2436446f53c405fabcf9df731464f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:02.254337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-842253a2-5ddd-4504-9ce4-50cb5044967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:02.353105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 910/1825] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:02.354175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:02.427401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922cfcd-a2a0-4ac4-af48-7abd45cf7c00 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:02.435338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:02.438141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:02.438141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:02.438141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:02.438141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:02.440281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:02.582214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 916/1826] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:02 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:02.586172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842253a2-5ddd-4504-9ce4-50cb5044967f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:02.599647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842253a2-5ddd-4504-9ce4-50cb5044967f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:02.725929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:02.727731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:02.728030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:02.728626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:02.730189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:02.734846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:02.818339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:02.821023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:02.852808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 911/1827] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:02 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:02.857704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:02.858799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d8e44-fa1e-4589-b5fa-a1deeedd3c35 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:02.865134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:02.866170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:02.866558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:02.866933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] PATH_INFO: `/v3/projects/8d0d631ac9b847c0981d5a321fef0d63` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:02.868374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0d631ac9b847c0981d5a321fef0d63)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:02.869479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1171550-09f3-4e84-a1dc-0c48b26883bf admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:02.870593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:02.883843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:02.884867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:02.885207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:02.885539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:02.888461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:02.891141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:02.923108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 912/1828] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:02.923108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:02.941290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5d867-3a55-4414-8f70-21c8e4d7432a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:02.949256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:02.954257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:02.954257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:02.954257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] PATH_INFO: `/v3/projects/d548b80822d14495a45a6f2d0822ea84/users/a8ca4623286849e6a91409342c503a6e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:02.990778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d548b80822d14495a45a6f2d0822ea84, user_id=a8ca4623286849e6a91409342c503a6e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:02.990778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:03.149189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 913/1829] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:02 2022] PUT /identity/v3/projects/d548b80822d14495a45a6f2d0822ea84/users/a8ca4623286849e6a91409342c503a6e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:03.152140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0d631ac9b847c0981d5a321fef0d63', 'request_id': 'req-c04a543e-6828-41de-a6d1-c53ef03940d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.155468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:03.159418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0d631ac9b847c0981d5a321fef0d63', 'request_id': 'req-c04a543e-6828-41de-a6d1-c53ef03940d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.276053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d3b8-29a7-452d-ab65-6c98713692b0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:03.284236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0d631ac9b847c0981d5a321fef0d63', 'request_id': 'req-c04a543e-6828-41de-a6d1-c53ef03940d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.285894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:03.287613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:03.287613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:03.288336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:03.289995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:03.294115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:03.310896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] The token cache is being invalidate because project 8d0d631ac9b847c0981d5a321fef0d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:03.311189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.312032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c04a543e-6828-41de-a6d1-c53ef03940d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.317577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 917/1830] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:02 2022] DELETE /identity/v3/projects/8d0d631ac9b847c0981d5a321fef0d63 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:03.319209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc3d4d-b0c6-43b1-857c-50771c53d25b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:03.325126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc3d4d-b0c6-43b1-857c-50771c53d25b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:03.325126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc3d4d-b0c6-43b1-857c-50771c53d25b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:03.326506 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 918/1831] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:19:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:19:03.327186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 914/1832] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:03.328440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc3d4d-b0c6-43b1-857c-50771c53d25b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:03.337845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:03.338972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6acc3d4d-b0c6-43b1-857c-50771c53d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:03.344055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:03.369216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc3d4d-b0c6-43b1-857c-50771c53d25b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:03.370602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a96190-af27-4454-945a-94dd362f9d05 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:03.380233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:03.381346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:03.381631 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:03.381907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] PATH_INFO: `/v3/users/695b3344e5f245e5b05b1c1601790e05` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:03.384187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=695b3344e5f245e5b05b1c1601790e05)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:03.387672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:03.388864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7697bbf-f4c7-46e7-9a25-8ec69b1604e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:03.390473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7697bbf-f4c7-46e7-9a25-8ec69b1604e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:03.393193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7697bbf-f4c7-46e7-9a25-8ec69b1604e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:03.393776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7697bbf-f4c7-46e7-9a25-8ec69b1604e6 admin admin] PATH_INFO: `/v3/projects/d548b80822d14495a45a6f2d0822ea84/users/a8ca4623286849e6a91409342c503a6e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:03.404834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7697bbf-f4c7-46e7-9a25-8ec69b1604e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d548b80822d14495a45a6f2d0822ea84, user_id=a8ca4623286849e6a91409342c503a6e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:03.416394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7697bbf-f4c7-46e7-9a25-8ec69b1604e6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:03.472680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 915/1833] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:03 2022] PUT /identity/v3/projects/d548b80822d14495a45a6f2d0822ea84/users/a8ca4623286849e6a91409342c503a6e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:03.474704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ceb2-fd8e-421f-897b-e4d57eda0cfb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:03.475152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ceb2-fd8e-421f-897b-e4d57eda0cfb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:03.475498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ceb2-fd8e-421f-897b-e4d57eda0cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:03.511810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-00c3ceb2-fd8e-421f-897b-e4d57eda0cfb None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:03.514095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-00c3ceb2-fd8e-421f-897b-e4d57eda0cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:03.661589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695b3344e5f245e5b05b1c1601790e05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.686859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695b3344e5f245e5b05b1c1601790e05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.695500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 916/1834] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:19:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:03.696988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:03.697447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695b3344e5f245e5b05b1c1601790e05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.697829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:03.698173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695b3344e5f245e5b05b1c1601790e05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.698283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:03.764568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] MFA Rules not processed for user `a8ca4623286849e6a91409342c503a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:03.765947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:03.814254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695b3344e5f245e5b05b1c1601790e05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:03.822342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 919/1835] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:03 2022] DELETE /identity/v3/users/695b3344e5f245e5b05b1c1601790e05 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:03.848918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 917/1836] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:03.869083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:03.871497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:03.890254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:03.956056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:03.958165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:03.978456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d69c7-f841-4f7f-b27e-09d122e7b237 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:03.982594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2f118-7246-44d6-91a8-31a49a65fa95 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:03.986682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:03.987343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:03.987626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:03.987900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:04.058343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:04.059850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:04.062716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8526-29e0-4cea-9f9f-7475ee7ae7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:04.063734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8526-29e0-4cea-9f9f-7475ee7ae7e0 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:04.064239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8526-29e0-4cea-9f9f-7475ee7ae7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:04.064536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8526-29e0-4cea-9f9f-7475ee7ae7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:04.068427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-057e8526-29e0-4cea-9f9f-7475ee7ae7e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:04.073401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 920/1837] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:04.094572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8526-29e0-4cea-9f9f-7475ee7ae7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:04.097119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8526-29e0-4cea-9f9f-7475ee7ae7e0 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:04.119930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 918/1838] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:04.455962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:04.457494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:04.551430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bb2fb-8494-438d-8358-01b6454ea03c service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:04.556763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:04.557673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:04.557928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:04.558203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] PATH_INFO: `/v3/projects/f07186ac1acd431bbb27da31452a1f60` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:04.560121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07186ac1acd431bbb27da31452a1f60)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:04.567194 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:04.715497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07186ac1acd431bbb27da31452a1f60', 'request_id': 'req-aa27bc31-4760-4058-b2fc-2f7b34fd8855'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:04.722739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:04.725754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07186ac1acd431bbb27da31452a1f60', 'request_id': 'req-aa27bc31-4760-4058-b2fc-2f7b34fd8855'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:04.907289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07186ac1acd431bbb27da31452a1f60', 'request_id': 'req-aa27bc31-4760-4058-b2fc-2f7b34fd8855'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:04.923738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] The token cache is being invalidate because project f07186ac1acd431bbb27da31452a1f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:04.924085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:04.924800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aa27bc31-4760-4058-b2fc-2f7b34fd8855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:04.926792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 921/1839] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:04 2022] DELETE /identity/v3/projects/f07186ac1acd431bbb27da31452a1f60 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:04.932932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d61d8-dfa8-4412-a119-47542c574f1d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:04.933732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d61d8-dfa8-4412-a119-47542c574f1d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:04.934743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d61d8-dfa8-4412-a119-47542c574f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:04.987290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-627d61d8-dfa8-4412-a119-47542c574f1d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:04.990629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-627d61d8-dfa8-4412-a119-47542c574f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:05.102218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97afa-98c2-4e22-9065-026fb5db448c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.102590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97afa-98c2-4e22-9065-026fb5db448c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.103083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97afa-98c2-4e22-9065-026fb5db448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.103331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 919/1840] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:05.152795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d1c97afa-98c2-4e22-9065-026fb5db448c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:05.156605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1c97afa-98c2-4e22-9065-026fb5db448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:05.191388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 922/1841] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:05.196359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d61d8-dfa8-4412-a119-47542c574f1d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:05.210812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d61d8-dfa8-4412-a119-47542c574f1d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:05.228330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:05.228330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.228330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.228330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.233649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:05.233649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:05.233649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:05.243267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 920/1842] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:19:05.255696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c97afa-98c2-4e22-9065-026fb5db448c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:05.265314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c97afa-98c2-4e22-9065-026fb5db448c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:05.270749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:05.271438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.271721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.271995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.272756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:05.274664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:05.450918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:05.453717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:05.468182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 923/1843] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:05 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:05.473291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:05.484862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee39761-8dfa-4760-bd14-91995dea45ee admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:05.803739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:05.803739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.803739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.803739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] PATH_INFO: `/v3/users/b2436446f53c405fabcf9df731464f64` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.804978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2436446f53c405fabcf9df731464f64)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:05.804978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:05.805710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6256b-685a-4f74-a24b-73192c69cf72 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:05.805710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:05.805710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.805710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.806351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.806351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:05.806351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:05.806351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 924/1844] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:05 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:05.806351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:05.806351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c74eb-1d74-42e4-9ec4-3ef4ea372cdc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:05.806733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:05.806733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.806733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.806733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.807030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:05.807030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:05.809425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 925/1845] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:05.812588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:05.822094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2174-80cb-4f8c-9c9e-8d37e9f910ff admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:05.827289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:05.827897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.828179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.828496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.829220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:05.830761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:05.842487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 926/1846] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:05.854492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:05.864982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b1e6e-5a4c-4819-8fd8-bb2b7e2002a9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:05.870307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612d03e-a09b-45ae-953e-029e247a4f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:05.871266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d03e-a09b-45ae-953e-029e247a4f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:05.871518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d03e-a09b-45ae-953e-029e247a4f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:05.872290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d03e-a09b-45ae-953e-029e247a4f6b admin admin] PATH_INFO: `/v3/projects/17d9a639a1a44a589e449a4b9879d9de/users/5c4eb00dd1dd449ebe8eccf56230429c/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:05.883368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2436446f53c405fabcf9df731464f64'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:05.888538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612d03e-a09b-45ae-953e-029e247a4f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d9a639a1a44a589e449a4b9879d9de, user_id=5c4eb00dd1dd449ebe8eccf56230429c, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:05.891514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612d03e-a09b-45ae-953e-029e247a4f6b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:05.892314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2436446f53c405fabcf9df731464f64'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:05.893076 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2436446f53c405fabcf9df731464f64'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:05.893687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2436446f53c405fabcf9df731464f64'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:05.907001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8a1c69ed-017e-44f4-b165-a23adbaad368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2436446f53c405fabcf9df731464f64'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:06.009931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 921/1847] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:05 2022] DELETE /identity/v3/users/b2436446f53c405fabcf9df731464f64 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:06.013850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 927/1848] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:05 2022] PUT /identity/v3/projects/17d9a639a1a44a589e449a4b9879d9de/users/5c4eb00dd1dd449ebe8eccf56230429c/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:06.015131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:06.015425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:06.015828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:06.018500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:06.018795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:06.019151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:06.033226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:06.034434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:06.036334 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:06.037542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:06.097428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 922/1849] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:06.101694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 928/1850] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:06.104652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:06.106783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:06.111396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:06.113344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:06.163090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8613e-3951-446e-893c-d059d0c3e213 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:06.167096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:06.167774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:06.168089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:06.168596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:06.172175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba464f3-6178-4448-9f69-5d11025c962e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:06.176387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:06.180882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:06.180882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:06.180882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:06.181292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:06.181292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:06.191285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:06.193029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 923/1851] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:06.193199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:06.212769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 929/1852] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:19:07.029420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:07.302941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:07.304482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:07.314372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:07.369906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:07.371995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717883f-1a35-49b2-83eb-b073dee012e4 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:07.372636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:07.376072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:07.376768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:07.377046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:07.377350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:07.379405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:07.396724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78b2d3-a077-4a00-bc52-36f79c1bd333 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:07.403812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:07.404653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:07.405399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:07.405679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] PATH_INFO: `/v3/projects/2b14c8224fc2479c90255d6533f6e665` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:07.406948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b14c8224fc2479c90255d6533f6e665)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:07.409570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:07.510444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:07.512899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:07.541936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 924/1853] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:07.552500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b14c8224fc2479c90255d6533f6e665', 'request_id': 'req-0cab7892-ce60-45c9-b6ad-e3baa070f88d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:07.559521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b14c8224fc2479c90255d6533f6e665', 'request_id': 'req-0cab7892-ce60-45c9-b6ad-e3baa070f88d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:07.660419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b14c8224fc2479c90255d6533f6e665', 'request_id': 'req-0cab7892-ce60-45c9-b6ad-e3baa070f88d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:07.678061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] The token cache is being invalidate because project 2b14c8224fc2479c90255d6533f6e665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:07.678352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:07.679057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cab7892-ce60-45c9-b6ad-e3baa070f88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:07.682127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 930/1854] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:07 2022] DELETE /identity/v3/projects/2b14c8224fc2479c90255d6533f6e665 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:07.686818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:07.701132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd06355-7248-4d2a-af48-b327087c3b38 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:07.788170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:07.789096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:07.789377 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:07.789651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] PATH_INFO: `/v3/users/a8ca4623286849e6a91409342c503a6e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:07.792981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ca4623286849e6a91409342c503a6e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:07.796024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:08.129032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ca4623286849e6a91409342c503a6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:08.136232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ca4623286849e6a91409342c503a6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:08.137037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ca4623286849e6a91409342c503a6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:08.137682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ca4623286849e6a91409342c503a6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:08.150121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ca4623286849e6a91409342c503a6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:08.236806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 925/1855] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:07 2022] DELETE /identity/v3/users/a8ca4623286849e6a91409342c503a6e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:08.665093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:08.666128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:08.666590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:08.721525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] MFA Rules not processed for user `5c4eb00dd1dd449ebe8eccf56230429c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:08.722685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:08.779425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:08.781953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:08.892251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 931/1856] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:08.895253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:08.896774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:08.910101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fb576-000b-42e9-827d-7188056508a4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:08.916957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:08.918209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde67c2e-5efe-4a40-b97c-f8c03db70b70 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:08.918848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:08.918848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:08.919801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] PATH_INFO: `/v3/projects/d548b80822d14495a45a6f2d0822ea84` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:08.920996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d548b80822d14495a45a6f2d0822ea84)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:08.923367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:08.923994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:08.924725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:08.925114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:08.925453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:08.926228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:08.929739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.081208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 932/1857] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:08 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:09.082363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.111184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd548b80822d14495a45a6f2d0822ea84', 'request_id': 'req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:09.164398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e10731-2628-4579-be9b-80e608c13723 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.221054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd548b80822d14495a45a6f2d0822ea84', 'request_id': 'req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:09.221343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.222128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.222484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.223290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.223529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.225712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.230349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd548b80822d14495a45a6f2d0822ea84', 'request_id': 'req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:09.239743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] The token cache is being invalidate because project d548b80822d14495a45a6f2d0822ea84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:09.240056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:09.240760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-10059eaf-79e3-4c26-8d9b-db4d0f8a4bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:09.242353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 926/1858] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:08 2022] DELETE /identity/v3/projects/d548b80822d14495a45a6f2d0822ea84 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:09.247364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2909f-20c2-43a7-a64a-36ad567a2c3b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.247644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2909f-20c2-43a7-a64a-36ad567a2c3b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.247914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2909f-20c2-43a7-a64a-36ad567a2c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.265882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-27e2909f-20c2-43a7-a64a-36ad567a2c3b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:09.267061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-27e2909f-20c2-43a7-a64a-36ad567a2c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:09.274970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 927/1859] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:09.283171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedf64-4c45-4a8f-8905-0f4a6d699208 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.283457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedf64-4c45-4a8f-8905-0f4a6d699208 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.283728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedf64-4c45-4a8f-8905-0f4a6d699208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.302012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0ffedf64-4c45-4a8f-8905-0f4a6d699208 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:09.303183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0ffedf64-4c45-4a8f-8905-0f4a6d699208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:09.311625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 928/1860] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:09.315472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffedf64-4c45-4a8f-8905-0f4a6d699208 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.324265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffedf64-4c45-4a8f-8905-0f4a6d699208 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.329636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.330285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.330566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.330841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.331612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:09.331892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.333612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.343262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 933/1861] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:09 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:09.347525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.349341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:09.350697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 929/1862] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:19:09.357374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.363031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3bde-9e43-4655-beaf-b2b0dea6d5b3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.376183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.376899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.377178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.377482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.385171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.389736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3224ef-d5be-4e03-9c8e-ec2b58d8ccd3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.390745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.401363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.403887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.404789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.405244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.407120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.410811 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.417405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 934/1863] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:09.429297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.440315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315e854-45d6-4050-a786-4791ad1390f6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.446233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.447288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.447573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.447848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] PATH_INFO: `/v3/projects/a0bc73fdf8584d28b81c9ea7f9b4edcd/users/09bfa0283a06499eaf7da5c553b2285a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.469402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc73fdf8584d28b81c9ea7f9b4edcd, user_id=09bfa0283a06499eaf7da5c553b2285a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.473297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.543991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 930/1864] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:09 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:09.546694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.585618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 935/1865] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:09 2022] PUT /identity/v3/projects/a0bc73fdf8584d28b81c9ea7f9b4edcd/users/09bfa0283a06499eaf7da5c553b2285a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:09.586493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.686242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c06a-8730-42d7-843e-c4fe824fa9e6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.690467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce3b91-f3ff-4397-8e3e-92b11a6a4cee admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.696450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.696450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.696450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.696450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.696801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.696801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.697002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.697684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.697971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.698251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.698952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.707383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.713248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 936/1866] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:09.714264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.726790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9b21-f2c8-4294-8899-1312c380c843 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.733481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.734892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.735245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.735595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] PATH_INFO: `/v3/projects/a0bc73fdf8584d28b81c9ea7f9b4edcd/users/09bfa0283a06499eaf7da5c553b2285a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.738607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc73fdf8584d28b81c9ea7f9b4edcd, user_id=09bfa0283a06499eaf7da5c553b2285a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.742318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.759728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 937/1867] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:09 2022] PUT /identity/v3/projects/a0bc73fdf8584d28b81c9ea7f9b4edcd/users/09bfa0283a06499eaf7da5c553b2285a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:09.832704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 931/1868] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:09 2022] POST /identity/v3/users => generated 282 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:09.836599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.900067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d5d8d-8929-4c21-92de-9d3c85c95a50 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.905746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.906439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.906722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.906998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.907741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.909400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.922815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 938/1869] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:09.928487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:09.951790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c086668-c884-4ba9-907b-364e59044664 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:09.966833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696dd22-ba88-402f-965e-99a858dab759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:09.967628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696dd22-ba88-402f-965e-99a858dab759 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:09.968274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696dd22-ba88-402f-965e-99a858dab759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:09.968739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696dd22-ba88-402f-965e-99a858dab759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:09.969814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696dd22-ba88-402f-965e-99a858dab759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:09.971610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696dd22-ba88-402f-965e-99a858dab759 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:09.987307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 932/1870] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:09.988956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:10.006749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a39cf-1ac5-4c98-9af2-96d328d518e7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:10.015565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:10.016593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:10.031867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:10.031867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] PATH_INFO: `/v3/projects/1f31c488d33846399696154071e22a50/users/6f793b635d3d4ce2a9293ff5810f9a70/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:10.048121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f31c488d33846399696154071e22a50, user_id=6f793b635d3d4ce2a9293ff5810f9a70, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:10.048121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:10.179866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 939/1871] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:09 2022] PUT /identity/v3/projects/1f31c488d33846399696154071e22a50/users/6f793b635d3d4ce2a9293ff5810f9a70/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:10.191430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcafe-d739-40ed-b871-cdc37de08119 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:10.191786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcafe-d739-40ed-b871-cdc37de08119 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:10.192155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcafe-d739-40ed-b871-cdc37de08119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:10.224962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ef3bcafe-d739-40ed-b871-cdc37de08119 None None] MFA Rules not processed for user `6f793b635d3d4ce2a9293ff5810f9a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:10.226448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ef3bcafe-d739-40ed-b871-cdc37de08119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:10.330579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:10.344237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 933/1872] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:10.344790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:10.467324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0e55-cf15-4049-89a4-b4a5abcc73d8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:10.473615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:10.474365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:10.474781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:10.475361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:10.475938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:10.478031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:10.602093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 940/1873] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:10 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:10.603367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bcafe-d739-40ed-b871-cdc37de08119 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:10.615025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bcafe-d739-40ed-b871-cdc37de08119 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:10.707089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:10.707089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:10.707089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:10.707089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:10.707437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:10.707437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:10.792542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 934/1874] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:10 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:10.793795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:10.808359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60b89-88f7-49f5-bf25-f189b2acdc67 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:10.815361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:10.816052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:10.816373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:10.816654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:10.817390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:10.819610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:10.821106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:10.832244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 941/1875] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:10.835942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:10.846796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e20f4e-c146-4039-bc82-03a908f0b790 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:10.851840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:10.855569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:10.855569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:10.855569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] PATH_INFO: `/v3/projects/2b9b7f03f4ec444aa22308636f9be219/users/bf08015e05174a2896cb378bdef09060/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:10.869881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9b7f03f4ec444aa22308636f9be219, user_id=bf08015e05174a2896cb378bdef09060, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:10.873403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:10.945348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 935/1876] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:10 2022] PUT /identity/v3/projects/2b9b7f03f4ec444aa22308636f9be219/users/bf08015e05174a2896cb378bdef09060/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:10.955762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:10.967595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2904-49ba-40dc-84f9-4425b9ddd8bc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:11.039989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00d5d2-be1d-4df3-8c8f-684e6b37ec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:11.040828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00d5d2-be1d-4df3-8c8f-684e6b37ec3c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:11.041202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00d5d2-be1d-4df3-8c8f-684e6b37ec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:11.041539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00d5d2-be1d-4df3-8c8f-684e6b37ec3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:11.042378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00d5d2-be1d-4df3-8c8f-684e6b37ec3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:11.044460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00d5d2-be1d-4df3-8c8f-684e6b37ec3c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:11.058317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 942/1877] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:11.062081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:11.075884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf816-48f1-4d97-9eb7-01acc374903a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:11.083986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:11.086101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:11.086492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:11.086876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] PATH_INFO: `/v3/projects/2b9b7f03f4ec444aa22308636f9be219/users/bf08015e05174a2896cb378bdef09060/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:11.091536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9b7f03f4ec444aa22308636f9be219, user_id=bf08015e05174a2896cb378bdef09060, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:11.097473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:11.142948 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 936/1878] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:11 2022] PUT /identity/v3/projects/2b9b7f03f4ec444aa22308636f9be219/users/bf08015e05174a2896cb378bdef09060/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:11.156234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10d44-1952-4ea8-925f-3d0568226f59 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:11.156234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10d44-1952-4ea8-925f-3d0568226f59 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:11.156234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10d44-1952-4ea8-925f-3d0568226f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:11.203427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d3a10d44-1952-4ea8-925f-3d0568226f59 None None] MFA Rules not processed for user `bf08015e05174a2896cb378bdef09060`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:11.204707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3a10d44-1952-4ea8-925f-3d0568226f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:11.311006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 943/1879] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:11.319101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:11.320853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:11.390151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca3ce-7473-4f10-8e9d-bb8d1b3b9b63 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:11.392673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:11.393424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:11.393777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:11.394128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:11.405343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:11.407887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:11.430141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 937/1880] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:11.679469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:11.679469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:11.679469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:11.722663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] MFA Rules not processed for user `09bfa0283a06499eaf7da5c553b2285a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:11.723529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:11.890670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 944/1881] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:11.935991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:11.937987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:11.953798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8dc3-b82c-438a-b1ad-4e6834f891f5 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:11.958031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:11.958762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:11.959116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:11.959467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:11.961806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:12.039473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:12.041563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:12.057552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 938/1882] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:12.627520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:12.936348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:13.138647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:13.140475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:13.214981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f550c-1be6-4217-a27d-da443b6273eb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:13.220753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:13.221876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:13.222162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:13.222439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] PATH_INFO: `/v3/users/52fe64ff6d5d4c17aeb36309a4f2d31d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:13.223704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fe64ff6d5d4c17aeb36309a4f2d31d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:13.225789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:13.594536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fe64ff6d5d4c17aeb36309a4f2d31d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:13.634077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fe64ff6d5d4c17aeb36309a4f2d31d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:13.647131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fe64ff6d5d4c17aeb36309a4f2d31d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:13.647898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fe64ff6d5d4c17aeb36309a4f2d31d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:13.750642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8cd1f77f-7fcb-4d64-bf6f-6830f7753d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fe64ff6d5d4c17aeb36309a4f2d31d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:13.754998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:13.767322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 945/1883] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:13 2022] DELETE /identity/v3/users/52fe64ff6d5d4c17aeb36309a4f2d31d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:13.768937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fff18-3649-410e-849e-0a8e16b99d6f service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:13.769202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:13.769502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:13.769776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:13.797826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:13.799283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:13.850835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:13.851918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:13.852224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:13.852507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] PATH_INFO: `/v3/users/6f793b635d3d4ce2a9293ff5810f9a70` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:13.854315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f793b635d3d4ce2a9293ff5810f9a70)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:13.857474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:13.895644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 946/1884] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:13.909938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:13.921586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:14.022277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a981f6-fab8-4eef-927b-93eec49a81fb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:14.030508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:14.031771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:14.033541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:14.033843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:14.064780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:14.067812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:14.107045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 947/1885] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:19:14.107045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:14.107392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:14.132147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f793b635d3d4ce2a9293ff5810f9a70'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:14.143371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f793b635d3d4ce2a9293ff5810f9a70'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:14.144399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f793b635d3d4ce2a9293ff5810f9a70'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:14.145255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f793b635d3d4ce2a9293ff5810f9a70'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:14.162568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1264ee7f-cce6-4c16-b5af-082c8386165d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f793b635d3d4ce2a9293ff5810f9a70'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:14.218868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b001-9874-410b-99b4-8b7f33e19643 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:14.225716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:14.225936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:14.226276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:14.226758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:14.229519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:14.274283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 939/1886] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:13 2022] DELETE /identity/v3/users/6f793b635d3d4ce2a9293ff5810f9a70 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:14.278987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:14.279713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:14.280225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:14.302964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:14.304799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:14.322204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:14.326179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:14.348369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 948/1887] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:14.416961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 940/1888] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:14.442612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:14.444032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:14.461874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9f2b-117b-4289-90a5-d18f9a05d1f7 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:14.564840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:14.569067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:14.569067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:14.569067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:14.593087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:14.594548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:14.615369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 949/1889] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:14.685928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:14.687555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:14.700376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6407c6-b5c0-4467-9dd9-2e87b822127f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:14.706809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:14.707877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:14.708237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:14.708624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] PATH_INFO: `/v3/projects/72934ebf655841748dcb838be44ba70f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:14.709957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72934ebf655841748dcb838be44ba70f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:14.712237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:14.922273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72934ebf655841748dcb838be44ba70f', 'request_id': 'req-06be8068-47c9-4fc0-be59-a7a7b602d984'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:14.927384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:15.021924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72934ebf655841748dcb838be44ba70f', 'request_id': 'req-06be8068-47c9-4fc0-be59-a7a7b602d984'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.031467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72934ebf655841748dcb838be44ba70f', 'request_id': 'req-06be8068-47c9-4fc0-be59-a7a7b602d984'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.044426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] The token cache is being invalidate because project 72934ebf655841748dcb838be44ba70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:15.044995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.045831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.048528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 941/1890] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:14 2022] DELETE /identity/v3/projects/72934ebf655841748dcb838be44ba70f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:15.052551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:15.066556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5438-9800-488b-b95a-6561525264e8 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:15.151694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:15.152910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:15.153277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:15.153678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] PATH_INFO: `/v3/users/ad33cc1741c743919c450493f303028c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:15.155020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad33cc1741c743919c450493f303028c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:15.157398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:15.463633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad33cc1741c743919c450493f303028c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.475290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad33cc1741c743919c450493f303028c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.483034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad33cc1741c743919c450493f303028c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.483803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad33cc1741c743919c450493f303028c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.575769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad33cc1741c743919c450493f303028c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:15.586989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 950/1891] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:15 2022] DELETE /identity/v3/users/ad33cc1741c743919c450493f303028c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:15.814554 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:16.066309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:16.068797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:16.088466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8068-47c9-4fc0-be59-a7a7b602d984 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:16.241031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:16.242622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:16.242847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:16.243451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] PATH_INFO: `/v3/projects/1f31c488d33846399696154071e22a50` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:16.245196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f31c488d33846399696154071e22a50)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:16.247710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:16.399143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f31c488d33846399696154071e22a50', 'request_id': 'req-e2578e4c-4345-4459-b7f2-781eaa0c1736'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.450627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:16.452355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:16.467090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91be68-ff7b-4b59-9302-d5dc4346fbeb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:16.512830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f31c488d33846399696154071e22a50', 'request_id': 'req-e2578e4c-4345-4459-b7f2-781eaa0c1736'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.520714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f31c488d33846399696154071e22a50', 'request_id': 'req-e2578e4c-4345-4459-b7f2-781eaa0c1736'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.538172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:16.540640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:16.544893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:16.544893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] PATH_INFO: `/v3/projects/36db63fe581747529d7b40350d0c44de` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:16.544893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36db63fe581747529d7b40350d0c44de)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:16.547057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:16.557591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] The token cache is being invalidate because project 1f31c488d33846399696154071e22a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:16.559386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.561378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.564422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 942/1892] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:16 2022] DELETE /identity/v3/projects/1f31c488d33846399696154071e22a50 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:16.568546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:16.578290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:16.601959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2578e4c-4345-4459-b7f2-781eaa0c1736 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:16.610407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:16.611302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:16.611584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:16.611864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] PATH_INFO: `/v3/users/bf08015e05174a2896cb378bdef09060` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:16.613134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf08015e05174a2896cb378bdef09060)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:16.615231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:16.753171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36db63fe581747529d7b40350d0c44de', 'request_id': 'req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.759250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36db63fe581747529d7b40350d0c44de', 'request_id': 'req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.827020 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf08015e05174a2896cb378bdef09060'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.845148 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf08015e05174a2896cb378bdef09060'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.846302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf08015e05174a2896cb378bdef09060'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.847021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf08015e05174a2896cb378bdef09060'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.865346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36db63fe581747529d7b40350d0c44de', 'request_id': 'req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.868577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf08015e05174a2896cb378bdef09060'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.883591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] The token cache is being invalidate because project 36db63fe581747529d7b40350d0c44de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:16.884086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.885123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:16.887562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 951/1893] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:16 2022] DELETE /identity/v3/projects/36db63fe581747529d7b40350d0c44de => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:16.891646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:16.905001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:16.905274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:16.980933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 943/1894] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:16 2022] DELETE /identity/v3/users/bf08015e05174a2896cb378bdef09060 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:17.166777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d6ff9-3838-4a4e-adf4-0eaa716a7b8c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:17.245110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:17.246051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:17.246328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:17.247170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] PATH_INFO: `/v3/users/cab7a8f689794e5db062a67abdbd60b9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:17.249357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab7a8f689794e5db062a67abdbd60b9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:17.251421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:17.532040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:17.532040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:17.548807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab7a8f689794e5db062a67abdbd60b9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.552071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cddc0-2bfd-4330-9836-4dba23f76d36 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:17.558491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:17.559468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:17.559749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:17.560893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] PATH_INFO: `/v3/projects/2b9b7f03f4ec444aa22308636f9be219` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:17.561492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9b7f03f4ec444aa22308636f9be219)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:17.563544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:17.586500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab7a8f689794e5db062a67abdbd60b9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.596249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab7a8f689794e5db062a67abdbd60b9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.598127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab7a8f689794e5db062a67abdbd60b9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.695665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-896a07f7-18fe-416c-a0de-53d52e8d8a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab7a8f689794e5db062a67abdbd60b9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.702971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 952/1895] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:16 2022] DELETE /identity/v3/users/cab7a8f689794e5db062a67abdbd60b9 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:17.758319 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9b7f03f4ec444aa22308636f9be219', 'request_id': 'req-fde57eed-3d0e-46e1-8108-2f6dcad28c40'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.895527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9b7f03f4ec444aa22308636f9be219', 'request_id': 'req-fde57eed-3d0e-46e1-8108-2f6dcad28c40'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.905170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9b7f03f4ec444aa22308636f9be219', 'request_id': 'req-fde57eed-3d0e-46e1-8108-2f6dcad28c40'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.923862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] The token cache is being invalidate because project 2b9b7f03f4ec444aa22308636f9be219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:17.924360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.925094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fde57eed-3d0e-46e1-8108-2f6dcad28c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:17.927459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 944/1896] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:17 2022] DELETE /identity/v3/projects/2b9b7f03f4ec444aa22308636f9be219 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:17.932515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f542-53db-4872-bee0-8029d565dac1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:17.932817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f542-53db-4872-bee0-8029d565dac1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:17.933085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f542-53db-4872-bee0-8029d565dac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:17.952052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4cc1f542-53db-4872-bee0-8029d565dac1 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:17.953322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4cc1f542-53db-4872-bee0-8029d565dac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:18.038806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 953/1897] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:18.047137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cbd08-8ee8-4e5a-b96b-ddf6d8841bea None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.047728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cbd08-8ee8-4e5a-b96b-ddf6d8841bea None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.048442 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cbd08-8ee8-4e5a-b96b-ddf6d8841bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.074155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-523cbd08-8ee8-4e5a-b96b-ddf6d8841bea None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:18.075492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-523cbd08-8ee8-4e5a-b96b-ddf6d8841bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:18.083782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 945/1898] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:18.089652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f542-53db-4872-bee0-8029d565dac1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.098625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f542-53db-4872-bee0-8029d565dac1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.104491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.105161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.105450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.105727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.107755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:18.108068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.109752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.127720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 954/1899] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:19:18.131239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cbd08-8ee8-4e5a-b96b-ddf6d8841bea None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.144332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cbd08-8ee8-4e5a-b96b-ddf6d8841bea None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.154637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.156123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.156573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.157001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.157931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.160105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.230214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.233380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:18.247557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4591b-9545-4d78-aaa9-472337058275 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.253163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.254238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.254525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.254803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] PATH_INFO: `/v3/projects/eb16e122eaba467e9a598ae57a949b77` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.256994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb16e122eaba467e9a598ae57a949b77)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.259135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.272749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 946/1900] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:18 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:18.275308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.362675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2464b-3877-403d-a1b9-3f86d0a4876c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.367812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.368885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.369255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.369578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.370362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.372626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.429508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:18.447101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb16e122eaba467e9a598ae57a949b77', 'request_id': 'req-9e4745d1-9c5d-4672-a4e4-b00c9903724e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:18.458257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb16e122eaba467e9a598ae57a949b77', 'request_id': 'req-9e4745d1-9c5d-4672-a4e4-b00c9903724e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:18.513859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 947/1901] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:18 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:18.513859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.513859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459edc2-df65-4264-9213-c040ea577a35 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.586579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.587279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.587565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.587846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.588821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.591155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.596483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb16e122eaba467e9a598ae57a949b77', 'request_id': 'req-9e4745d1-9c5d-4672-a4e4-b00c9903724e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:18.605624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 948/1902] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:18.607201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.618356 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef1a66-e83b-4050-a224-3bab21110479 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.623651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] The token cache is being invalidate because project eb16e122eaba467e9a598ae57a949b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:18.623841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.624428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:18.624612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.624878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.625163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.625904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.626122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e4745d1-9c5d-4672-a4e4-b00c9903724e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:18.627578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.628389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 955/1903] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:18 2022] DELETE /identity/v3/projects/eb16e122eaba467e9a598ae57a949b77 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:18.635253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430bda-d8b2-4b19-9275-f3c0a851b262 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.636084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430bda-d8b2-4b19-9275-f3c0a851b262 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.636732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430bda-d8b2-4b19-9275-f3c0a851b262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.643405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 949/1904] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:18.644759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.646577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:18.662066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965021-79e3-4230-8a31-55ef74c183e0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.673340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-41430bda-d8b2-4b19-9275-f3c0a851b262 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:18.675314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-41430bda-d8b2-4b19-9275-f3c0a851b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:18.676933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce9e77-89ed-4fcd-8ad3-47a6d3cdac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.680415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9e77-89ed-4fcd-8ad3-47a6d3cdac90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.680415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9e77-89ed-4fcd-8ad3-47a6d3cdac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.680415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9e77-89ed-4fcd-8ad3-47a6d3cdac90 admin admin] PATH_INFO: `/v3/projects/21e586edbb8f49c4b07f2a51814bb22d/users/143f055cff3942419fe948b58fc011c8/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.703181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 956/1905] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:18.714965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a316d1-df83-49b5-979b-cf1d8b486379 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.714965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a316d1-df83-49b5-979b-cf1d8b486379 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.714965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a316d1-df83-49b5-979b-cf1d8b486379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.715350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce9e77-89ed-4fcd-8ad3-47a6d3cdac90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e586edbb8f49c4b07f2a51814bb22d, user_id=143f055cff3942419fe948b58fc011c8, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.716747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce9e77-89ed-4fcd-8ad3-47a6d3cdac90 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.750174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-26a316d1-df83-49b5-979b-cf1d8b486379 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:18.751423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-26a316d1-df83-49b5-979b-cf1d8b486379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:18.768740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 957/1906] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:18.772854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a316d1-df83-49b5-979b-cf1d8b486379 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.792987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a316d1-df83-49b5-979b-cf1d8b486379 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.799806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb85523-1439-484a-87af-420710942228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.800527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb85523-1439-484a-87af-420710942228 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.800811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb85523-1439-484a-87af-420710942228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.801399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb85523-1439-484a-87af-420710942228 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.802154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb85523-1439-484a-87af-420710942228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:18.802457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb85523-1439-484a-87af-420710942228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.804252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb85523-1439-484a-87af-420710942228 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.818710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 958/1907] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:19:18.822723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb85523-1439-484a-87af-420710942228 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.835576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb85523-1439-484a-87af-420710942228 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:18.840665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:18.841333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.841613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.841886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.842573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:18.844791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:18.875408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 950/1908] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:18 2022] PUT /identity/v3/projects/21e586edbb8f49c4b07f2a51814bb22d/users/143f055cff3942419fe948b58fc011c8/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:18.886445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:18.886573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:18.886768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:18.914995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] MFA Rules not processed for user `143f055cff3942419fe948b58fc011c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:18.925970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:18.985331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 951/1909] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:18.996695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:18.998332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:19.016868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 959/1910] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:18 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:19.020984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:19.068045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6b2c-ba5c-4186-8e22-cd487fdf412b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:19.089402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8304-0604-46e6-a9f5-1b1972ef0e7f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:19.097146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:19.097823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:19.098111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:19.098385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:19.099083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:19.101049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:19.122543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:19.123335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:19.123735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:19.124075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:19.183208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:19.185064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:19.194684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 952/1911] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:19:19.295423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 960/1912] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:19 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:19.299579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:19.312287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76922-4781-4354-87ff-00db99bef411 service glance] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:19.318236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:19.319144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:19.319434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:19.319709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:19.320469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:19.322528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:19.350158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 953/1913] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:19.354098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:19.369690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef28e9-56eb-423c-8731-db64e48d3fc6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:19.382278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06ebb1-2f11-4d4d-a616-74af49e96433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:19.382278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ebb1-2f11-4d4d-a616-74af49e96433 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:19.382278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ebb1-2f11-4d4d-a616-74af49e96433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:19.382278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ebb1-2f11-4d4d-a616-74af49e96433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:19.382702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06ebb1-2f11-4d4d-a616-74af49e96433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:19.382702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06ebb1-2f11-4d4d-a616-74af49e96433 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:19.393044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 961/1914] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:19.397001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:19.415792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4d90e-a596-4910-ac28-f3418f2eed71 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:19.422207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:19.423222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:19.423595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:19.423962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] PATH_INFO: `/v3/projects/984c2c9d027e488face614592889daac/users/5071fbef06a146a29c5d50fef545b567/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:19.449272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984c2c9d027e488face614592889daac, user_id=5071fbef06a146a29c5d50fef545b567, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:19.453998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:19.536281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 954/1915] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:19 2022] PUT /identity/v3/projects/984c2c9d027e488face614592889daac/users/5071fbef06a146a29c5d50fef545b567/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:19.547733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622449b-6944-409c-b826-9487eb1d5cfb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:19.548098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622449b-6944-409c-b826-9487eb1d5cfb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:19.548475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622449b-6944-409c-b826-9487eb1d5cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:19.588757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7622449b-6944-409c-b826-9487eb1d5cfb None None] MFA Rules not processed for user `5071fbef06a146a29c5d50fef545b567`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:19.591028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7622449b-6944-409c-b826-9487eb1d5cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:19.667674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 962/1916] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:19.673219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:19.749292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:19.754156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66c26-585b-4a19-b4f7-ebb2df1b7062 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:19.759748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:19.760431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:19.760733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:19.764777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:19.764777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:19.764777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:19.974701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 955/1917] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:19 2022] POST /identity/v3/projects => generated 379 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:19.979034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622449b-6944-409c-b826-9487eb1d5cfb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:19.996502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622449b-6944-409c-b826-9487eb1d5cfb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:20.081198 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:20.081988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:20.082344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:20.082690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:20.083462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:20.085488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:20.269929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 963/1918] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:19 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:20.273753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:20.286657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748ba87-8842-46ff-a2c1-31def326d858 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:20.291314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:20.292035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:20.292357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:20.292639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:20.293372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:20.294978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:20.307827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 956/1919] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:20.318137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:20.329253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d27d-cd3a-4bb2-b2d0-a64777933a7f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:20.334227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f121217-6591-41fa-b536-9df3fbea2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:20.334882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f121217-6591-41fa-b536-9df3fbea2295 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:20.335161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f121217-6591-41fa-b536-9df3fbea2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:20.335481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f121217-6591-41fa-b536-9df3fbea2295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:20.336186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f121217-6591-41fa-b536-9df3fbea2295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:20.337805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f121217-6591-41fa-b536-9df3fbea2295 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:20.356190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 964/1920] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:20.360488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:20.372672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48961-46f3-4662-93d5-c1038ee3d0c5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:20.378046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:20.378862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:20.379139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:20.379796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] PATH_INFO: `/v3/projects/371f8cc065234f83818b375c000a6b7c/users/1a72a5dc016b492c910e9b06b2d9dbcb/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:20.395696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=371f8cc065234f83818b375c000a6b7c, user_id=1a72a5dc016b492c910e9b06b2d9dbcb, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:20.398532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:20.503611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 957/1921] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:20 2022] PUT /identity/v3/projects/371f8cc065234f83818b375c000a6b7c/users/1a72a5dc016b492c910e9b06b2d9dbcb/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:20.522205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d9e6a-1545-4f97-8ff9-158590dfb006 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:20.522517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d9e6a-1545-4f97-8ff9-158590dfb006 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:20.522804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d9e6a-1545-4f97-8ff9-158590dfb006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:20.571975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ef8d9e6a-1545-4f97-8ff9-158590dfb006 None None] MFA Rules not processed for user `1a72a5dc016b492c910e9b06b2d9dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:20.573288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef8d9e6a-1545-4f97-8ff9-158590dfb006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:20.669104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 965/1922] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:20.673360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:20.772051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf7f3c-ea81-4360-bba9-5b038b45f97e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:20.772051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:20.772051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:20.772051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:20.772578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:20.773276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:20.775489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:20.917741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d9e6a-1545-4f97-8ff9-158590dfb006 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:20.924431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 958/1923] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:20 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:20.933487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d9e6a-1545-4f97-8ff9-158590dfb006 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:20.936692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:21.000524 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:21.001285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.001485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.001761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.002571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:21.004954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:21.104395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:21.140572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 966/1924] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:20 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:21.140674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:21.150834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3b78-26d5-4e59-b8c3-cece27bbe19e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:21.156547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:21.157208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.157500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.157827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.158552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:21.160143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:21.172100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 959/1925] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:21.177858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:21.188681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbd38a-961e-473f-93f6-5cfda5bec319 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:21.193391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:21.194277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.194563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.194843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] PATH_INFO: `/v3/projects/fcfc8d0aa2354d39a89621d983160630/users/5c2fecd0fffd480b8af90ad124f2e1cd/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.210747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcfc8d0aa2354d39a89621d983160630, user_id=5c2fecd0fffd480b8af90ad124f2e1cd, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:21.213477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:21.364449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 967/1926] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:21 2022] PUT /identity/v3/projects/fcfc8d0aa2354d39a89621d983160630/users/5c2fecd0fffd480b8af90ad124f2e1cd/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:21.368449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:21.378765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc02dc-39a4-49a0-9dbe-ee3004db6aeb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:21.437775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8a793-8149-428a-bf74-1331198c42d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:21.438477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8a793-8149-428a-bf74-1331198c42d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.438758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8a793-8149-428a-bf74-1331198c42d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.439032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8a793-8149-428a-bf74-1331198c42d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.439760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8a793-8149-428a-bf74-1331198c42d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:21.441501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8a793-8149-428a-bf74-1331198c42d9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:21.451842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 960/1927] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:21.456093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:21.467086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728d774-deac-4b71-9762-539289a62915 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:21.471863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:21.472779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.473056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.473349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] PATH_INFO: `/v3/projects/fcfc8d0aa2354d39a89621d983160630/users/5c2fecd0fffd480b8af90ad124f2e1cd/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.475304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcfc8d0aa2354d39a89621d983160630, user_id=5c2fecd0fffd480b8af90ad124f2e1cd, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:21.477984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:21.488810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 968/1928] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:21 2022] PUT /identity/v3/projects/fcfc8d0aa2354d39a89621d983160630/users/5c2fecd0fffd480b8af90ad124f2e1cd/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:21.500428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.500714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.500992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.529896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] MFA Rules not processed for user `5c2fecd0fffd480b8af90ad124f2e1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:21.532018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:21.610204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 961/1929] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:21.622311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:21.624026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:21.692686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0f9a-f4a1-4031-b451-9833bc607d3f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:21.696453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:21.697101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.697386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.697662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.707929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:21.710258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:21.722225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 969/1930] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:21.863029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:21.864619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:21.877898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a642a-eb45-435f-a3da-485c6255e976 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:21.881959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696c549-5c91-4020-a440-6567f5da381e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:21.884027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c549-5c91-4020-a440-6567f5da381e service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:21.884027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c549-5c91-4020-a440-6567f5da381e service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:21.884027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c549-5c91-4020-a440-6567f5da381e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:21.942454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696c549-5c91-4020-a440-6567f5da381e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:21.943830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696c549-5c91-4020-a440-6567f5da381e service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:21.953530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 962/1931] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:22.587334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:23.296671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:23.381480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:24.810478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:24.901884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:25.996484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:26.496122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:26.501229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:26.564102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a20ce-e842-4b7f-898f-af710036cb40 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:26.569343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:26.570400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:26.570681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:26.570953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] PATH_INFO: `/v3/users/5071fbef06a146a29c5d50fef545b567` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:26.572155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5071fbef06a146a29c5d50fef545b567)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:26.574148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:26.824913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5071fbef06a146a29c5d50fef545b567'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:26.837233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5071fbef06a146a29c5d50fef545b567'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:26.844390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5071fbef06a146a29c5d50fef545b567'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:26.845114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5071fbef06a146a29c5d50fef545b567'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:26.907821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5071fbef06a146a29c5d50fef545b567'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:26.914596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 970/1932] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:26 2022] DELETE /identity/v3/users/5071fbef06a146a29c5d50fef545b567 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:26.919109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:26.919402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:26.919683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:26.941729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:26.946006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:27.004500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 963/1933] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:27.014424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:27.015815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:27.075670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7855fe-0bf3-48d5-840d-076056a7d365 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:27.079603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:27.080285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:27.080572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:27.081022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:27.090186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:27.091604 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:27.102050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 971/1934] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:27.550238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:27.552859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:27.567833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ec45f-46b6-4592-a822-1a80d2dd43b9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:27.574119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:27.575093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:27.578721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:27.578721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] PATH_INFO: `/v3/projects/984c2c9d027e488face614592889daac` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:27.578721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984c2c9d027e488face614592889daac)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:27.579906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:27.748073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984c2c9d027e488face614592889daac', 'request_id': 'req-742e0920-7e9e-40c2-b808-7549453d79c7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:27.872679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984c2c9d027e488face614592889daac', 'request_id': 'req-742e0920-7e9e-40c2-b808-7549453d79c7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:27.880346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984c2c9d027e488face614592889daac', 'request_id': 'req-742e0920-7e9e-40c2-b808-7549453d79c7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:27.896035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] The token cache is being invalidate because project 984c2c9d027e488face614592889daac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:27.896573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:27.897255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:27.898849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 964/1935] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:27 2022] DELETE /identity/v3/projects/984c2c9d027e488face614592889daac => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:27.903016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:27.913043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426b467-5943-4be0-a040-8b90c3a50aa0 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:27.982498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:27.983494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:27.983850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:27.984212 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] PATH_INFO: `/v3/users/1a72a5dc016b492c910e9b06b2d9dbcb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:27.985579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a72a5dc016b492c910e9b06b2d9dbcb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:27.988682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:28.113519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:28.279219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a72a5dc016b492c910e9b06b2d9dbcb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:28.290985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a72a5dc016b492c910e9b06b2d9dbcb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:28.298794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a72a5dc016b492c910e9b06b2d9dbcb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:28.299549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a72a5dc016b492c910e9b06b2d9dbcb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:28.449873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a72a5dc016b492c910e9b06b2d9dbcb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:28.456653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 972/1936] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:27 2022] DELETE /identity/v3/users/1a72a5dc016b492c910e9b06b2d9dbcb => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:28.814319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:28.937649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:28.939207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:28.954800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0920-7e9e-40c2-b808-7549453d79c7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:29.019278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:29.020132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:29.020458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:29.020737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] PATH_INFO: `/v3/projects/371f8cc065234f83818b375c000a6b7c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:29.021919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=371f8cc065234f83818b375c000a6b7c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:29.023825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:29.349182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371f8cc065234f83818b375c000a6b7c', 'request_id': 'req-093cb4a1-85c5-49b3-8130-d0564cc3dffd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.459578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371f8cc065234f83818b375c000a6b7c', 'request_id': 'req-093cb4a1-85c5-49b3-8130-d0564cc3dffd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.468638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371f8cc065234f83818b375c000a6b7c', 'request_id': 'req-093cb4a1-85c5-49b3-8130-d0564cc3dffd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.482536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] The token cache is being invalidate because project 371f8cc065234f83818b375c000a6b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:29.482905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.483855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.485787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 965/1937] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:28 2022] DELETE /identity/v3/projects/371f8cc065234f83818b375c000a6b7c => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:29.489703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:29.491212 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:29.507379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410ac8b-8a22-40a5-98f9-fc951b9fdec8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:29.570749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:29.571778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:29.572124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:29.572499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] PATH_INFO: `/v3/users/5c2fecd0fffd480b8af90ad124f2e1cd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:29.573973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2fecd0fffd480b8af90ad124f2e1cd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:29.578976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:29.846290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2fecd0fffd480b8af90ad124f2e1cd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.859763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2fecd0fffd480b8af90ad124f2e1cd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.866587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2fecd0fffd480b8af90ad124f2e1cd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.867327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2fecd0fffd480b8af90ad124f2e1cd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.935964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e197df90-b0ba-497b-9a6c-4883ff87bd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2fecd0fffd480b8af90ad124f2e1cd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:29.942925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 973/1938] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:29 2022] DELETE /identity/v3/users/5c2fecd0fffd480b8af90ad124f2e1cd => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:30.010763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:30.363983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:30.365940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:30.380046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:30.384525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cb4a1-85c5-49b3-8130-d0564cc3dffd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:30.448699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:30.449567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:30.449917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:30.450208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] PATH_INFO: `/v3/projects/fcfc8d0aa2354d39a89621d983160630` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:30.451407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcfc8d0aa2354d39a89621d983160630)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:30.453882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:30.606084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcfc8d0aa2354d39a89621d983160630', 'request_id': 'req-6df69a2b-40b5-43ef-8f12-08c76b6ba183'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:30.728241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcfc8d0aa2354d39a89621d983160630', 'request_id': 'req-6df69a2b-40b5-43ef-8f12-08c76b6ba183'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:30.735272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcfc8d0aa2354d39a89621d983160630', 'request_id': 'req-6df69a2b-40b5-43ef-8f12-08c76b6ba183'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:30.749559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] The token cache is being invalidate because project fcfc8d0aa2354d39a89621d983160630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:30.749559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:30.749559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6df69a2b-40b5-43ef-8f12-08c76b6ba183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:30.750651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 966/1939] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:30 2022] DELETE /identity/v3/projects/fcfc8d0aa2354d39a89621d983160630 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:30.757297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3c465-8699-40f5-9637-93f6b5be30e4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:30.757755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3c465-8699-40f5-9637-93f6b5be30e4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:30.757861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3c465-8699-40f5-9637-93f6b5be30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:30.788440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-70b3c465-8699-40f5-9637-93f6b5be30e4 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:30.788440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70b3c465-8699-40f5-9637-93f6b5be30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:30.860022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 974/1940] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:30.868544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387f1f-396b-4e8e-8827-4a8e5cc4d3e8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:30.868828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387f1f-396b-4e8e-8827-4a8e5cc4d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:30.869103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387f1f-396b-4e8e-8827-4a8e5cc4d3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:30.890437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e2387f1f-396b-4e8e-8827-4a8e5cc4d3e8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:30.891672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e2387f1f-396b-4e8e-8827-4a8e5cc4d3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:30.900351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 967/1941] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:30.905073 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3c465-8699-40f5-9637-93f6b5be30e4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:30.914771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3c465-8699-40f5-9637-93f6b5be30e4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:30.919974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:30.921139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:30.921139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:30.921502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:30.922295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:30.922668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:30.924351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:30.939704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 975/1942] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:19:30.942324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387f1f-396b-4e8e-8827-4a8e5cc4d3e8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:30.952532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387f1f-396b-4e8e-8827-4a8e5cc4d3e8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:30.957397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:30.958106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:30.958440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:30.958779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:30.959534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:30.961633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.067786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 968/1943] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:30 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:31.071945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:31.083027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e1b3-bc63-494c-9df3-4c0b44e44796 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:31.143905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:31.144625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.144906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.145182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.145884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:31.147812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.148035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:31.249168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 976/1944] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:31 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:31.254213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:31.264531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946498ed-a53d-43d9-8a74-41f910f5091d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:31.269430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:31.270186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.270534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.270876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.271611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:31.273299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.284813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 969/1945] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:31.288959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:31.304447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd981b-6d64-4adf-9052-44cb826097c3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:31.304630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b48853-9e9a-4ca0-806d-01de1588698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:31.305241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b48853-9e9a-4ca0-806d-01de1588698a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.305525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b48853-9e9a-4ca0-806d-01de1588698a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.305803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b48853-9e9a-4ca0-806d-01de1588698a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.306778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b48853-9e9a-4ca0-806d-01de1588698a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:31.308397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b48853-9e9a-4ca0-806d-01de1588698a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.319264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 977/1946] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:31.323428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:31.333735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491caeb-9c1b-4066-a319-17c289a52ed8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:31.338566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:31.339545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.339890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.340262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] PATH_INFO: `/v3/projects/14b6c7389f3448449683c924ec5570c9/users/def0172dacd64a71af01593abe496139/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.358713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b6c7389f3448449683c924ec5570c9, user_id=def0172dacd64a71af01593abe496139, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:31.361773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.434329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 970/1947] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:31 2022] PUT /identity/v3/projects/14b6c7389f3448449683c924ec5570c9/users/def0172dacd64a71af01593abe496139/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:31.447951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe80a-baf3-4ec6-9228-d4f75cf72007 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.450305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe80a-baf3-4ec6-9228-d4f75cf72007 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.450606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe80a-baf3-4ec6-9228-d4f75cf72007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.481694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4b6fe80a-baf3-4ec6-9228-d4f75cf72007 None None] MFA Rules not processed for user `def0172dacd64a71af01593abe496139`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:31.483612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b6fe80a-baf3-4ec6-9228-d4f75cf72007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:31.556912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 978/1948] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:31.561427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:31.638249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e3421-8565-4093-b246-9b7f4cc0d211 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:31.643809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:31.645937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.645937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.645937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.646314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:31.648384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.789758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 971/1949] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:31.790969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe80a-baf3-4ec6-9228-d4f75cf72007 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:31.792732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:31.803601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe80a-baf3-4ec6-9228-d4f75cf72007 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:31.857799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:31.859115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.859314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.859596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.860311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:31.862235 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.950904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 979/1950] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:31 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:31.952557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:31.963337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac9b4-d884-4f1c-ab62-7513e4a9911b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:31.969161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:31.969870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:31.970205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:31.970480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:31.971208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:31.972875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:31.985477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 972/1951] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:31.989564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:32.000572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abf821-d3a3-40af-8562-cac74bb37157 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:32.006289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:32.007179 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:32.007455 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:32.007723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] PATH_INFO: `/v3/projects/b2a821a881c9484fb5aa048ce2eae8c2/users/5fcb60c4c21c4320938dad6fd3a44ed8/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:32.023152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a821a881c9484fb5aa048ce2eae8c2, user_id=5fcb60c4c21c4320938dad6fd3a44ed8, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:32.025861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:32.089114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 980/1952] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:31 2022] PUT /identity/v3/projects/b2a821a881c9484fb5aa048ce2eae8c2/users/5fcb60c4c21c4320938dad6fd3a44ed8/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:32.093190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:32.103226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df2cf-bfc5-4d62-98b9-410b16c8d892 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:32.160341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae1bc-39c2-4d4a-be9e-4ec980add243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:32.160998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae1bc-39c2-4d4a-be9e-4ec980add243 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:32.161279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae1bc-39c2-4d4a-be9e-4ec980add243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:32.161604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae1bc-39c2-4d4a-be9e-4ec980add243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:32.162457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae1bc-39c2-4d4a-be9e-4ec980add243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:32.164060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae1bc-39c2-4d4a-be9e-4ec980add243 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:32.175225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 973/1953] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:32.179678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:32.198879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddccb4e-7fc2-4e80-8b2b-0fd45b035cec admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:32.198879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:32.198879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:32.198879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:32.199226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] PATH_INFO: `/v3/projects/b2a821a881c9484fb5aa048ce2eae8c2/users/5fcb60c4c21c4320938dad6fd3a44ed8/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:32.200492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a821a881c9484fb5aa048ce2eae8c2, user_id=5fcb60c4c21c4320938dad6fd3a44ed8, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:32.203177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:32.213574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 981/1954] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:32 2022] PUT /identity/v3/projects/b2a821a881c9484fb5aa048ce2eae8c2/users/5fcb60c4c21c4320938dad6fd3a44ed8/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:32.224939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e5d3f-4d6b-4f10-8749-6decb55787be None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:32.225277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e5d3f-4d6b-4f10-8749-6decb55787be None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:32.225562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e5d3f-4d6b-4f10-8749-6decb55787be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:32.258721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6f7e5d3f-4d6b-4f10-8749-6decb55787be None None] MFA Rules not processed for user `5fcb60c4c21c4320938dad6fd3a44ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:32.259928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6f7e5d3f-4d6b-4f10-8749-6decb55787be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:32.328212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 974/1955] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:32.339171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:32.340987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:32.402945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290116aa-3bef-4d4f-9aa4-a415ae66414b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:32.407114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:32.407798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:32.408086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:32.408406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:32.418123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:32.419806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:32.431253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 982/1956] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:33.131016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:33.203711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=18,keystone:SELECT=81,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:33.700255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e5d3f-4d6b-4f10-8749-6decb55787be None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:33.772292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e5d3f-4d6b-4f10-8749-6decb55787be None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:33.782280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:33.783197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:33.783741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:33.783942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] PATH_INFO: `/v3/users/def0172dacd64a71af01593abe496139` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:33.785139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def0172dacd64a71af01593abe496139)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:33.787097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:34.079369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def0172dacd64a71af01593abe496139'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.086029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def0172dacd64a71af01593abe496139'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.086693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def0172dacd64a71af01593abe496139'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.087302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def0172dacd64a71af01593abe496139'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.100593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b917b168-c3cf-4a87-aea2-64e5131b74f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def0172dacd64a71af01593abe496139'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.126264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:34.127829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:34.143856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881372-a0f3-4a1b-b5dd-bad3b2652385 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:34.149087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:34.149611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:34.149894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:34.150170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] PATH_INFO: `/v3/users/5c4eb00dd1dd449ebe8eccf56230429c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:34.151351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4eb00dd1dd449ebe8eccf56230429c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:34.153305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:34.181176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 975/1957] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:33 2022] DELETE /identity/v3/users/def0172dacd64a71af01593abe496139 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:34.185909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:34.186932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:34.187218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:34.205340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:34.206448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:34.267935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 976/1958] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:34.276780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:34.278178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:34.347433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac660d-fd65-4b47-9cf7-90f9a2c5a362 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:34.350564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:34.351286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:34.351784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:34.352058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:34.361966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:34.363431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:34.373019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 977/1959] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:19:34.373177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4eb00dd1dd449ebe8eccf56230429c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.385819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4eb00dd1dd449ebe8eccf56230429c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.393673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4eb00dd1dd449ebe8eccf56230429c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.394637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4eb00dd1dd449ebe8eccf56230429c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.482413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4eb00dd1dd449ebe8eccf56230429c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:34.489155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 983/1960] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:34 2022] DELETE /identity/v3/users/5c4eb00dd1dd449ebe8eccf56230429c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:34.817977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:34.819583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:34.835015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8de5-c2cb-47a5-817a-962f5483a7f9 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:34.851485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:34.854520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:34.906078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:34.907260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:34.907613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:34.907959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] PATH_INFO: `/v3/projects/17d9a639a1a44a589e449a4b9879d9de` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:34.909210 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d9a639a1a44a589e449a4b9879d9de)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:34.911123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:34.930624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507679c-82bc-439b-bb0e-1781d6df861e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:34.937228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:34.939287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:34.939788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:34.940067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] PATH_INFO: `/v3/projects/14b6c7389f3448449683c924ec5570c9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:34.941453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b6c7389f3448449683c924ec5570c9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:34.943450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:35.080723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d9a639a1a44a589e449a4b9879d9de', 'request_id': 'req-622386e4-37e7-4abc-8fcb-05cb2b6192fd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.085708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b6c7389f3448449683c924ec5570c9', 'request_id': 'req-f7a71781-1631-4578-a949-20e98b21a971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.091297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b6c7389f3448449683c924ec5570c9', 'request_id': 'req-f7a71781-1631-4578-a949-20e98b21a971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.210160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d9a639a1a44a589e449a4b9879d9de', 'request_id': 'req-622386e4-37e7-4abc-8fcb-05cb2b6192fd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.217878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d9a639a1a44a589e449a4b9879d9de', 'request_id': 'req-622386e4-37e7-4abc-8fcb-05cb2b6192fd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.228492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] The token cache is being invalidate because project 17d9a639a1a44a589e449a4b9879d9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:35.228779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.229430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.230987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 978/1961] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:34 2022] DELETE /identity/v3/projects/17d9a639a1a44a589e449a4b9879d9de => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:35.235506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:35.236847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:35.272494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b6c7389f3448449683c924ec5570c9', 'request_id': 'req-f7a71781-1631-4578-a949-20e98b21a971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.284727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] The token cache is being invalidate because project 14b6c7389f3448449683c924ec5570c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:35.285017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.285652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.287195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 984/1962] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:34 2022] DELETE /identity/v3/projects/14b6c7389f3448449683c924ec5570c9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:35.291412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:35.293014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:35.302525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622386e4-37e7-4abc-8fcb-05cb2b6192fd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:35.361169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:35.361311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a71781-1631-4578-a949-20e98b21a971 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:35.362216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:35.362578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:35.364218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] PATH_INFO: `/v3/users/09bfa0283a06499eaf7da5c553b2285a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:35.364328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09bfa0283a06499eaf7da5c553b2285a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:35.366403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:35.367967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:35.368928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:35.369264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:35.369594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] PATH_INFO: `/v3/users/5fcb60c4c21c4320938dad6fd3a44ed8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:35.372076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fcb60c4c21c4320938dad6fd3a44ed8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:35.373082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:35.428775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:35.486993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=6,keystone:DELETE=8,keystone:SELECT=86 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:35.553444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09bfa0283a06499eaf7da5c553b2285a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.561543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09bfa0283a06499eaf7da5c553b2285a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.562316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09bfa0283a06499eaf7da5c553b2285a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.562942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09bfa0283a06499eaf7da5c553b2285a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.580031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fcb60c4c21c4320938dad6fd3a44ed8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.589220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09bfa0283a06499eaf7da5c553b2285a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.599273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fcb60c4c21c4320938dad6fd3a44ed8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.606050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fcb60c4c21c4320938dad6fd3a44ed8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.606793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fcb60c4c21c4320938dad6fd3a44ed8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.683341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 979/1963] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:35 2022] DELETE /identity/v3/users/09bfa0283a06499eaf7da5c553b2285a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:35.803411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b2fa2231-1103-409f-884d-a2f1a271f632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fcb60c4c21c4320938dad6fd3a44ed8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:35.810484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 985/1964] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:35 2022] DELETE /identity/v3/users/5fcb60c4c21c4320938dad6fd3a44ed8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:36.027137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:36.028630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:36.099484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5028-fca5-45dc-afc0-a62fb8cfc249 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:36.156624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:36.163567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.163567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.163567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] PATH_INFO: `/v3/projects/a0bc73fdf8584d28b81c9ea7f9b4edcd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.163567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bc73fdf8584d28b81c9ea7f9b4edcd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:36.163567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:36.387032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bc73fdf8584d28b81c9ea7f9b4edcd', 'request_id': 'req-a0eaa2ee-6386-4ecc-8110-a33737501d21'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.516902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bc73fdf8584d28b81c9ea7f9b4edcd', 'request_id': 'req-a0eaa2ee-6386-4ecc-8110-a33737501d21'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.517478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:36.523641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bc73fdf8584d28b81c9ea7f9b4edcd', 'request_id': 'req-a0eaa2ee-6386-4ecc-8110-a33737501d21'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.533898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] The token cache is being invalidate because project a0bc73fdf8584d28b81c9ea7f9b4edcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:36.534188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.534892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.536578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 980/1965] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:36 2022] DELETE /identity/v3/projects/a0bc73fdf8584d28b81c9ea7f9b4edcd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:36.542259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659b2e-65f5-464d-8d1d-20fd08c4d1db None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.542552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659b2e-65f5-464d-8d1d-20fd08c4d1db None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.542851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659b2e-65f5-464d-8d1d-20fd08c4d1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.563400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-34659b2e-65f5-464d-8d1d-20fd08c4d1db None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:36.566227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34659b2e-65f5-464d-8d1d-20fd08c4d1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:36.599015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:36.603269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:36.634863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 986/1966] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:36.642747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057982-41a7-4914-bbbd-65aca624361a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.643056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057982-41a7-4914-bbbd-65aca624361a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.643407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057982-41a7-4914-bbbd-65aca624361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.662339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-aa057982-41a7-4914-bbbd-65aca624361a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:36.663942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aa057982-41a7-4914-bbbd-65aca624361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:36.672434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 987/1967] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:36.674905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa2ee-6386-4ecc-8110-a33737501d21 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:36.676674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa057982-41a7-4914-bbbd-65aca624361a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:36.679717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:36.680597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.680877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.681249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] PATH_INFO: `/v3/projects/b2a821a881c9484fb5aa048ce2eae8c2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.682693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a821a881c9484fb5aa048ce2eae8c2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:36.684625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:36.686085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa057982-41a7-4914-bbbd-65aca624361a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:36.690739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:36.691386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.691669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.691943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.692742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:36.698432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:36.698432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:36.711784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 988/1968] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:19:36.712804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:36.722889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a1d1-7929-4699-b071-9fdf36bcdc7b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:36.727391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:36.728033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.728344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.728624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.729310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:36.731206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:36.792103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a821a881c9484fb5aa048ce2eae8c2', 'request_id': 'req-f31ddf76-b8df-4748-a876-9a775dd8e60e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.872833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 989/1969] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:36 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:36.877449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:36.906156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a821a881c9484fb5aa048ce2eae8c2', 'request_id': 'req-f31ddf76-b8df-4748-a876-9a775dd8e60e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.913702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a821a881c9484fb5aa048ce2eae8c2', 'request_id': 'req-f31ddf76-b8df-4748-a876-9a775dd8e60e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.926659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] The token cache is being invalidate because project b2a821a881c9484fb5aa048ce2eae8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:36.927080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.927853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f31ddf76-b8df-4748-a876-9a775dd8e60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:36.929570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 981/1970] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:36 2022] DELETE /identity/v3/projects/b2a821a881c9484fb5aa048ce2eae8c2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:36.934501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b4e75-01e8-4bb8-a722-7ad88f85f834 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.934789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b4e75-01e8-4bb8-a722-7ad88f85f834 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.935128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b4e75-01e8-4bb8-a722-7ad88f85f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.945890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99927b8-d56b-409a-be7b-a5fbc9f82440 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:36.951510 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:36.952296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.952652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.953160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:36.953928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:36.955620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-913b4e75-01e8-4bb8-a722-7ad88f85f834 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:36.956948 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-913b4e75-01e8-4bb8-a722-7ad88f85f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:36.957140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:36.966091 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 982/1971] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:36.974909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7892-9b79-45ad-b5f2-461259445fa5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:36.977694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7892-9b79-45ad-b5f2-461259445fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:36.977694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7892-9b79-45ad-b5f2-461259445fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.001169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a77d7892-9b79-45ad-b5f2-461259445fa5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:37.002097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a77d7892-9b79-45ad-b5f2-461259445fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:37.010674 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 983/1972] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:37.014795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7892-9b79-45ad-b5f2-461259445fa5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.024257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7892-9b79-45ad-b5f2-461259445fa5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.029062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.029724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.030616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.031217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.031583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:37.031889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.033605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.047413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 984/1973] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:19:37.051787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.061710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116d4b1-816b-4023-bdac-76d50c05866f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.066558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.067204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.067486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.067816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.068540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.070431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.074332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 990/1974] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:36 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:37.081493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.083304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:37.096428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddacf11-1c92-416a-be59-c78ce47f3356 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.101366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.102031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.102321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.102600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.103328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.105002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.115664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 991/1975] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:37.119509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.129238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ead41-9228-4fd4-9389-6c140fd059e0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.133840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.134510 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.134791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.135070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.144405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.144405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.148752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 992/1976] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:37.152940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.163894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20b7d-68bc-4dcf-929c-7dabbca0d6af admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.168889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4991d3-37be-44e1-9b23-3ac84f207449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.169901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4991d3-37be-44e1-9b23-3ac84f207449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.170278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4991d3-37be-44e1-9b23-3ac84f207449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.170760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4991d3-37be-44e1-9b23-3ac84f207449 admin admin] PATH_INFO: `/v3/projects/3a9ab08f54cb46f69dcb54670c7963ba/users/92b3b270555a43d383064b5b390a0ead/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.175789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 985/1977] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:37 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:37.176691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.187427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4991d3-37be-44e1-9b23-3ac84f207449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9ab08f54cb46f69dcb54670c7963ba, user_id=92b3b270555a43d383064b5b390a0ead, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.190160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4991d3-37be-44e1-9b23-3ac84f207449 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.246219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57019-2432-4dd2-9bd7-a58d5329150f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.251690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.252447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.252701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.252971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.253658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.255613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.272627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 993/1978] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:37 2022] PUT /identity/v3/projects/3a9ab08f54cb46f69dcb54670c7963ba/users/92b3b270555a43d383064b5b390a0ead/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:37.283919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.284224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.284515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.311400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] MFA Rules not processed for user `92b3b270555a43d383064b5b390a0ead`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:37.313505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:37.381923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 986/1979] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:37 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:37.385990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.392043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 994/1980] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:37.397844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2840-5cce-4e6b-83e4-f51a6b633d8d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.404648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.406633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:37.478798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3076f-848a-4101-b84e-a03ff5845a02 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.484275 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.486268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.486268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.486268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.486617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.487644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.488151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.488472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.489235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.491049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.499355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.500869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.504248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 987/1981] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:37.506947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.518322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 995/1982] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:19:37.522189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287331-df1d-4dbd-9a58-0a759bcef395 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.529149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f323a-b878-49de-9596-745e2f877e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.529875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f323a-b878-49de-9596-745e2f877e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.530242 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f323a-b878-49de-9596-745e2f877e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.530593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f323a-b878-49de-9596-745e2f877e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.532385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f323a-b878-49de-9596-745e2f877e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.534222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f323a-b878-49de-9596-745e2f877e60 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.555317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 988/1983] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:37.564767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.588872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24204987-6841-4329-8cdc-9c21d8b90444 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.594429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.601039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.601039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.601039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] PATH_INFO: `/v3/projects/a5ed895d8ac44e6a8a054e134442af81/users/8f1c43cdf9824397af31a830b6ee2892/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.613675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ed895d8ac44e6a8a054e134442af81, user_id=8f1c43cdf9824397af31a830b6ee2892, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.617576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.787871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 996/1984] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:37 2022] PUT /identity/v3/projects/a5ed895d8ac44e6a8a054e134442af81/users/8f1c43cdf9824397af31a830b6ee2892/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:37.799658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5af2-75ec-42f7-a6af-af6cc8c7bd6d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.799943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5af2-75ec-42f7-a6af-af6cc8c7bd6d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.801341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5af2-75ec-42f7-a6af-af6cc8c7bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.826878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-044c5af2-75ec-42f7-a6af-af6cc8c7bd6d None None] MFA Rules not processed for user `8f1c43cdf9824397af31a830b6ee2892`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:37.828061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-044c5af2-75ec-42f7-a6af-af6cc8c7bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:37.893136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 989/1985] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:37.903922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:37.905933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:37.963595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:37.967717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7325dd-9bbf-45c4-a340-485900624016 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:37.971599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24686e01-e628-4d01-8939-2cb2edb9ef34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:37.972286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686e01-e628-4d01-8939-2cb2edb9ef34 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:37.977876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686e01-e628-4d01-8939-2cb2edb9ef34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:37.977876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686e01-e628-4d01-8939-2cb2edb9ef34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:37.981698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24686e01-e628-4d01-8939-2cb2edb9ef34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:37.983756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24686e01-e628-4d01-8939-2cb2edb9ef34 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:37.993147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 997/1986] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:38.450961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:39.268550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:40.708022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:40.783450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:40.909110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5af2-75ec-42f7-a6af-af6cc8c7bd6d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:40.981887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5af2-75ec-42f7-a6af-af6cc8c7bd6d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:40.987837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:40.988827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:40.989108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:40.989380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] PATH_INFO: `/v3/users/92b3b270555a43d383064b5b390a0ead` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:40.990582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b3b270555a43d383064b5b390a0ead)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:40.993190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:41.211734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b3b270555a43d383064b5b390a0ead'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.219857 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b3b270555a43d383064b5b390a0ead'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.220605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b3b270555a43d383064b5b390a0ead'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.221220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b3b270555a43d383064b5b390a0ead'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.235374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b3b270555a43d383064b5b390a0ead'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.324662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 990/1987] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:40 2022] DELETE /identity/v3/users/92b3b270555a43d383064b5b390a0ead => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:41.330118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d67ab-847c-4973-b6cf-6fb0ee31f1fd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:41.330394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d67ab-847c-4973-b6cf-6fb0ee31f1fd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:41.330740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d67ab-847c-4973-b6cf-6fb0ee31f1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:41.349269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fc7d67ab-847c-4973-b6cf-6fb0ee31f1fd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:41.350490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fc7d67ab-847c-4973-b6cf-6fb0ee31f1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:41.415653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 998/1988] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:41.425909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:41.427633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:41.455663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbca118-ddd7-4051-913b-d5e514aab8ff None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:41.455971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbca118-ddd7-4051-913b-d5e514aab8ff None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:41.456490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbca118-ddd7-4051-913b-d5e514aab8ff None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:41.458246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 999/1989] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:19:41.474914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:41.475222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:41.475574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:41.494638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b63190-3fb6-4a13-8db8-f2cb94664ba4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:41.502056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:41.502840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:41.503354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] MFA Rules not processed for user `a535c818476847f5bfe081a66a239331`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:41.503476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:41.503823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:41.504637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:41.517887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:41.519740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:41.534724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 991/1990] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:41.602157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1000/1991] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:19:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:41.621936 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:41.622811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:41.623897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:41.624225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:41.639360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e9833-ac65-4b05-9879-4de367db9977 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:41.641414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf13eb-5af7-49d2-921b-2bf8490a99a8 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:41.645616 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:41.646715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:41.646816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:41.646950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:41.647150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] PATH_INFO: `/v3/users/f611b3dde95e44c7931445bb3ef1f59a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:41.647258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:41.647546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:41.647821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:41.649048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f611b3dde95e44c7931445bb3ef1f59a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:41.650994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:41.657434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:41.659020 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:41.669946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 992/1992] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:41.810230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:41.862735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f611b3dde95e44c7931445bb3ef1f59a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.875682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f611b3dde95e44c7931445bb3ef1f59a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.882588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f611b3dde95e44c7931445bb3ef1f59a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.883364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f611b3dde95e44c7931445bb3ef1f59a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:41.972312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:41.975056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:41.988430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa60db-2d0a-4b46-84a1-af0933d9e00f service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:41.993304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:41.994161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:41.994444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:41.994720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] PATH_INFO: `/v3/projects/3a9ab08f54cb46f69dcb54670c7963ba` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:41.995950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9ab08f54cb46f69dcb54670c7963ba)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:41.997962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.004591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f611b3dde95e44c7931445bb3ef1f59a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.011828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1001/1993] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:41 2022] DELETE /identity/v3/users/f611b3dde95e44c7931445bb3ef1f59a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:42.183735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9ab08f54cb46f69dcb54670c7963ba', 'request_id': 'req-f29989f9-921a-4178-b840-e8623d582f45'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.204786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:42.309030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.310479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:42.313502 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9ab08f54cb46f69dcb54670c7963ba', 'request_id': 'req-f29989f9-921a-4178-b840-e8623d582f45'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.323649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9ab08f54cb46f69dcb54670c7963ba', 'request_id': 'req-f29989f9-921a-4178-b840-e8623d582f45'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.337265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] The token cache is being invalidate because project 3a9ab08f54cb46f69dcb54670c7963ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:42.337565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.338422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f29989f9-921a-4178-b840-e8623d582f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.340437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 993/1994] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:41 2022] DELETE /identity/v3/projects/3a9ab08f54cb46f69dcb54670c7963ba => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:42.346063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7640-656b-4bac-a47a-a479cf680e38 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.346351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7640-656b-4bac-a47a-a479cf680e38 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.346627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7640-656b-4bac-a47a-a479cf680e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.369719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4b2a7640-656b-4bac-a47a-a479cf680e38 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:42.370425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b2a7640-656b-4bac-a47a-a479cf680e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:42.385943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4894b-3faf-4d12-9aa3-43910ad17683 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.431100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 994/1995] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:42.438866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195c04f-db80-4b21-8e0a-a3da3565e78d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.439156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195c04f-db80-4b21-8e0a-a3da3565e78d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.439434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195c04f-db80-4b21-8e0a-a3da3565e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.442944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.443805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.444082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.444401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] PATH_INFO: `/v3/projects/14f7d7e0a5614243974c4c44ec466b14` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.445597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f7d7e0a5614243974c4c44ec466b14)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.447513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.457903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f195c04f-db80-4b21-8e0a-a3da3565e78d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:42.459102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f195c04f-db80-4b21-8e0a-a3da3565e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:42.466968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 995/1996] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:42.471657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195c04f-db80-4b21-8e0a-a3da3565e78d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.480662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195c04f-db80-4b21-8e0a-a3da3565e78d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.487903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.488628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.488901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.489173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.489895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:42.490198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.491780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.503906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 996/1997] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:19:42.508105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.518238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2995d-ec20-4e99-b226-cc2ad6eafc7c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.523081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.524097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.524647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.525150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.526010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.528516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.579372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f7d7e0a5614243974c4c44ec466b14', 'request_id': 'req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.585623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f7d7e0a5614243974c4c44ec466b14', 'request_id': 'req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.665150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 997/1998] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/projects => generated 389 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:42.666240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.683127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f7d7e0a5614243974c4c44ec466b14', 'request_id': 'req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.696791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] The token cache is being invalidate because project 14f7d7e0a5614243974c4c44ec466b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:42.696791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.696972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-54dfc844-766f-4ca9-9d4b-efe4d47cc5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:42.698532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1002/1999] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:42 2022] DELETE /identity/v3/projects/14f7d7e0a5614243974c4c44ec466b14 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:42.707139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40462d5-8eec-4123-8b0e-4d1abf4855c9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.707429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40462d5-8eec-4123-8b0e-4d1abf4855c9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.707711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40462d5-8eec-4123-8b0e-4d1abf4855c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.728933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a40462d5-8eec-4123-8b0e-4d1abf4855c9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:42.730143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a40462d5-8eec-4123-8b0e-4d1abf4855c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:42.734557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a4c38-78ac-4f85-8484-a6bbb1278a03 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.738536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1003/2000] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:42.739647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.740352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.740641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.740921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.741738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.743686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.746360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45211366-b257-4574-b3d8-556e967599f8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.746639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45211366-b257-4574-b3d8-556e967599f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.746926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45211366-b257-4574-b3d8-556e967599f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.767159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-45211366-b257-4574-b3d8-556e967599f8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:42.768403 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-45211366-b257-4574-b3d8-556e967599f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:42.778249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1004/2001] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:42.783061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45211366-b257-4574-b3d8-556e967599f8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.793727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45211366-b257-4574-b3d8-556e967599f8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.799762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.800612 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.810490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.810490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.810490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:42.810490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.810490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.818385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1005/2002] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:19:42.821633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.833033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ff5f4-4981-4e69-aa87-d2e7f2500b20 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.837936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.838397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.838674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.838943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.839716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.841649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.857696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 998/2003] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:42.859056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.860780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:42.873141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8d6c-c5f8-4400-9b51-8c33b7e25f01 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.879340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.880069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.880572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.880684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.886191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.886191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.895260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 999/2004] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:42.899199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.909445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608f843-0b2b-4de5-879c-c0e2aff763a4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.914422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.915010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.920501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.920501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.920501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.920501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:42.928731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1000/2005] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:42.933385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.944027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c5f52-ce29-42a4-a390-e9fe37d4a976 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:42.948859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf9ff5-c295-47a5-a30f-d73afcc4b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:42.949882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9ff5-c295-47a5-a30f-d73afcc4b141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:42.950165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9ff5-c295-47a5-a30f-d73afcc4b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:42.950439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9ff5-c295-47a5-a30f-d73afcc4b141 admin admin] PATH_INFO: `/v3/projects/8ca6e214b2e1451cafacefdec3259a15/users/a79b35ced6ab4d2e9c9784d33e8b4aa7/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:42.954027 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1006/2006] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:42.957553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:42.970846 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf9ff5-c295-47a5-a30f-d73afcc4b141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca6e214b2e1451cafacefdec3259a15, user_id=a79b35ced6ab4d2e9c9784d33e8b4aa7, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:42.974090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf9ff5-c295-47a5-a30f-d73afcc4b141 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:43.019222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7bda4-14c7-4583-a6de-bcce85bd6b0a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:43.023902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:43.024588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.024869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.025250 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.025817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:43.027725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:43.067006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1001/2007] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:42 2022] PUT /identity/v3/projects/8ca6e214b2e1451cafacefdec3259a15/users/a79b35ced6ab4d2e9c9784d33e8b4aa7/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:19:43.078228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.078648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.078924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.104114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] MFA Rules not processed for user `a79b35ced6ab4d2e9c9784d33e8b4aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:43.105301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:43.169612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1002/2008] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:43.180749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:43.182305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:43.204945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1007/2009] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:42 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:43.209075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:43.220443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0312fb-cde2-4235-a8de-99707d3066bb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:43.243215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117faae-e133-4333-86bb-ab5083f0af06 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:43.246879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:43.247519 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.247796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.248068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.257272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:43.258709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:43.267727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1003/2010] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:19:43.277720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:43.278393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.278679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.278958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.279683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:43.281540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:43.291372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1008/2011] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:43.295358 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:43.306670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731a17a-a48d-492f-9526-e0c0e609f727 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:43.311721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0a831-bd68-46cb-a276-31b5ae7ed031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:43.312956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a831-bd68-46cb-a276-31b5ae7ed031 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.313236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a831-bd68-46cb-a276-31b5ae7ed031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.313678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a831-bd68-46cb-a276-31b5ae7ed031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.314409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0a831-bd68-46cb-a276-31b5ae7ed031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:43.315985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0a831-bd68-46cb-a276-31b5ae7ed031 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:43.330396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1004/2012] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:19:43.331569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:43.341865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d69c8-c5d4-4d23-9bb5-c06ae73156ed admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:43.346689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:43.347571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.347861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.348131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] PATH_INFO: `/v3/projects/894cff7b9106408bb865f52debd2b2dd/users/7c30caf193324cc88eadf14f82a74a57/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.368734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=894cff7b9106408bb865f52debd2b2dd, user_id=7c30caf193324cc88eadf14f82a74a57, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:43.372129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:43.385535 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:43.485582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1009/2013] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:43 2022] PUT /identity/v3/projects/894cff7b9106408bb865f52debd2b2dd/users/7c30caf193324cc88eadf14f82a74a57/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:43.496960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.497253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.497538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.526799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] MFA Rules not processed for user `7c30caf193324cc88eadf14f82a74a57`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:43.527990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:43.560144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:43.602702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1005/2014] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:19:43.614676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:43.617888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:43.691153 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862614c-3a93-490c-8424-d827c00dab2f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:43.699115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a75b2-a90f-45d3-916b-dfdfe37999fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:43.699837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a75b2-a90f-45d3-916b-dfdfe37999fc service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:43.700637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a75b2-a90f-45d3-916b-dfdfe37999fc service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:43.700637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a75b2-a90f-45d3-916b-dfdfe37999fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:43.710543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a75b2-a90f-45d3-916b-dfdfe37999fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:43.712176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a75b2-a90f-45d3-916b-dfdfe37999fc service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:43.722861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1010/2015] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:44.548413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:45.205156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:45.673373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:45.674871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:45.747730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4b17-2690-436c-a6b5-1dfb52da1502 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:45.749809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:45.750790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:45.751076 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:45.751444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] PATH_INFO: `/v3/users/143f055cff3942419fe948b58fc011c8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:45.752695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143f055cff3942419fe948b58fc011c8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:45.754621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:45.966563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143f055cff3942419fe948b58fc011c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:45.975338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143f055cff3942419fe948b58fc011c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:45.976078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143f055cff3942419fe948b58fc011c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:45.976783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143f055cff3942419fe948b58fc011c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:45.989859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143f055cff3942419fe948b58fc011c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:46.079907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1006/2016] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:19:45 2022] DELETE /identity/v3/users/143f055cff3942419fe948b58fc011c8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:46.085856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:46.085856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:46.085856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:46.133740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:46.134899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:46.252142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1011/2017] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:46.257601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:46.259105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:46.320831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4fb2c-b86a-41bc-aa11-bd1b99c6fdc3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:46.324423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612bc81-db4a-41a0-b9ab-9be8f00bb241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:46.325068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612bc81-db4a-41a0-b9ab-9be8f00bb241 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:46.325349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612bc81-db4a-41a0-b9ab-9be8f00bb241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:46.325620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612bc81-db4a-41a0-b9ab-9be8f00bb241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:46.340100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612bc81-db4a-41a0-b9ab-9be8f00bb241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:46.340100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612bc81-db4a-41a0-b9ab-9be8f00bb241 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:46.346817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1007/2018] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:46.370454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:46.784309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:46.787708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:46.804563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbfd28-e0a6-4b12-9939-497933d34cf7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:46.811628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:46.812819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:46.813168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:46.813454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] PATH_INFO: `/v3/projects/21e586edbb8f49c4b07f2a51814bb22d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:46.814972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e586edbb8f49c4b07f2a51814bb22d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:46.816949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:46.919012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e586edbb8f49c4b07f2a51814bb22d', 'request_id': 'req-7795e0b1-743d-4042-9f56-2af56ae61449'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:46.925701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e586edbb8f49c4b07f2a51814bb22d', 'request_id': 'req-7795e0b1-743d-4042-9f56-2af56ae61449'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:47.014029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e586edbb8f49c4b07f2a51814bb22d', 'request_id': 'req-7795e0b1-743d-4042-9f56-2af56ae61449'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:47.027908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] The token cache is being invalidate because project 21e586edbb8f49c4b07f2a51814bb22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:19:47.028222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:47.028848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7795e0b1-743d-4042-9f56-2af56ae61449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:19:47.030375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1012/2019] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:19:46 2022] DELETE /identity/v3/projects/21e586edbb8f49c4b07f2a51814bb22d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:47.036151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5a1b-a21d-4ea6-bd35-c894862944c3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.036726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5a1b-a21d-4ea6-bd35-c894862944c3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.037082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5a1b-a21d-4ea6-bd35-c894862944c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.055932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-816c5a1b-a21d-4ea6-bd35-c894862944c3 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:47.057422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-816c5a1b-a21d-4ea6-bd35-c894862944c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:47.081075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:47.122974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1008/2020] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:47.131701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60d00-f822-44bf-bfac-f25f0c6deaa9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.132247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60d00-f822-44bf-bfac-f25f0c6deaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.132461 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60d00-f822-44bf-bfac-f25f0c6deaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.151166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c0d60d00-f822-44bf-bfac-f25f0c6deaa9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:47.152429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c0d60d00-f822-44bf-bfac-f25f0c6deaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:47.162532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1013/2021] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:47.165648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c5a1b-a21d-4ea6-bd35-c894862944c3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:47.175585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c5a1b-a21d-4ea6-bd35-c894862944c3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:47.180349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:47.181011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.181291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.181565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.182645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:19:47.182836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:47.184463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:47.197074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1009/2022] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:19:47.201689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60d00-f822-44bf-bfac-f25f0c6deaa9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:47.212611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60d00-f822-44bf-bfac-f25f0c6deaa9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:47.217304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:47.217949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.218230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.218941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.219670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:47.221662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:47.360855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1014/2023] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:19:47 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:19:47.367059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:47.380653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b211ee1-5e40-4a7f-88c4-3f519770ea5f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:47.440130 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:47.440892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.441178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.441496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.442185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:47.444254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:47.563690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1010/2024] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:19:47 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:19:47.567885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:47.578529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ce12-273f-447c-b6ab-954a2a82492e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:47.583856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:47.584290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.584575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.584850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.585576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:47.587204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:47.598057 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1015/2025] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:47.602047 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:47.613325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55abfd2-7c62-460b-b149-186e0b78879b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:47.618049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a560408-47ba-40d4-873e-6a7b4fb904db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:47.618707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560408-47ba-40d4-873e-6a7b4fb904db admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.618987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560408-47ba-40d4-873e-6a7b4fb904db admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.619262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560408-47ba-40d4-873e-6a7b4fb904db admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.619983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a560408-47ba-40d4-873e-6a7b4fb904db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:47.621615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a560408-47ba-40d4-873e-6a7b4fb904db admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:47.633572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1011/2026] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:19:47.637655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:47.647449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a007c-21de-4ac0-a94a-0712b02af095 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:47.652009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:47.652924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.653206 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.653479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] PATH_INFO: `/v3/projects/10208e026095483b8d527560b319874c/users/6fc50e9e80aa4c86928bda39a03ecd4f/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.668991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10208e026095483b8d527560b319874c, user_id=6fc50e9e80aa4c86928bda39a03ecd4f, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:47.672180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:47.742065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1016/2027] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:19:47 2022] PUT /identity/v3/projects/10208e026095483b8d527560b319874c/users/6fc50e9e80aa4c86928bda39a03ecd4f/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:19:47.758511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.758805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.759089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.785768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] MFA Rules not processed for user `6fc50e9e80aa4c86928bda39a03ecd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:19:47.786964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:47.850166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1012/2028] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:19:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:19:47.861335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:19:47.863054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:19:47.891016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:47.921406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c19d-885f-4c80-b04f-066a5ed32074 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:19:47.925758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:19:47.926411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:19:47.926696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:19:47.926982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:19:47.935655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:19:47.937122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:19:47.945941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1017/2029] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:19:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:19:48.387129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:48.902066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:49.088564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:49.265825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:49.662474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:50.054411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:50.336233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:50.536351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:50.713388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:50.782063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:51.193240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:51.266673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:51.528924 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:51.574617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:51.717392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:51.968923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:52.033770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:19:52.324793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:01.538801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:01.539597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:01.616231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:01.618286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:01.644588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56451d2a-86a4-4cd3-9a37-86a5e31c2fc6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:01.645481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:01.646383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:01.646676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:01.646970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] PATH_INFO: `/v3/users/7c30caf193324cc88eadf14f82a74a57` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:01.648178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c30caf193324cc88eadf14f82a74a57)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:01.650430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:01.690469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba1fba-b5b5-4333-a504-aa9218045559 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:01.695395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:01.696300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:01.696583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:01.696860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] PATH_INFO: `/v3/users/6fc50e9e80aa4c86928bda39a03ecd4f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:01.698052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc50e9e80aa4c86928bda39a03ecd4f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:01.700029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:01.862783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c30caf193324cc88eadf14f82a74a57'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.869648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c30caf193324cc88eadf14f82a74a57'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.870346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c30caf193324cc88eadf14f82a74a57'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.870960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c30caf193324cc88eadf14f82a74a57'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.883952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a30dad-768f-469b-afbc-7c8c823b13a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c30caf193324cc88eadf14f82a74a57'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.893646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc50e9e80aa4c86928bda39a03ecd4f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.908460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc50e9e80aa4c86928bda39a03ecd4f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.912622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc50e9e80aa4c86928bda39a03ecd4f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.913337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc50e9e80aa4c86928bda39a03ecd4f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:01.999228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1013/2030] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:01 2022] DELETE /identity/v3/users/7c30caf193324cc88eadf14f82a74a57 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:02.003754 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:02.004069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:02.004379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:02.021485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:02.026174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:02.067583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6bb61069-b2cd-4025-8447-96ca1e0aad18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc50e9e80aa4c86928bda39a03ecd4f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:02.076089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1018/2031] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:01 2022] DELETE /identity/v3/users/6fc50e9e80aa4c86928bda39a03ecd4f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:02.082684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eb609-1161-4ab7-955f-792e912da0ba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:02.082684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eb609-1161-4ab7-955f-792e912da0ba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:02.082684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eb609-1161-4ab7-955f-792e912da0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:02.084088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1014/2032] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:02.093985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:02.096068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:02.105098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a43eb609-1161-4ab7-955f-792e912da0ba None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:02.106335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a43eb609-1161-4ab7-955f-792e912da0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:02.154154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727af9b-8418-4f28-af56-66e7c8174c1d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:02.167223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1019/2033] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:02.177502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eb609-1161-4ab7-955f-792e912da0ba None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:02.179002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:02.187192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:02.212737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:02.213309 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:02.213591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:02.213866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:02.223128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:02.224624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:02.234290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1015/2034] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:02.235209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eb609-1161-4ab7-955f-792e912da0ba None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:02.245792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:02.246452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:02.246729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:02.247002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:02.259238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:02.260721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:02.271863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1020/2035] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:02.634621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:02.636235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:02.649279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab43d8c-d76b-4865-896a-2a80460f1858 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:02.655411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:02.656377 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:02.656655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:02.656956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] PATH_INFO: `/v3/users/8f1c43cdf9824397af31a830b6ee2892` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:02.658266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1c43cdf9824397af31a830b6ee2892)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:02.660428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:02.890594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:02.890594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:02.904092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2887d-b16b-41c4-848a-6dc10e78d897 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:02.914649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:02.914649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:02.914649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:02.914649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] PATH_INFO: `/v3/projects/10208e026095483b8d527560b319874c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:02.915007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=10208e026095483b8d527560b319874c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:02.915007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:02.929414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1c43cdf9824397af31a830b6ee2892'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:02.936898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1c43cdf9824397af31a830b6ee2892'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:02.937631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1c43cdf9824397af31a830b6ee2892'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:02.938438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1c43cdf9824397af31a830b6ee2892'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:02.952919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1c43cdf9824397af31a830b6ee2892'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.028670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1016/2036] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:02 2022] DELETE /identity/v3/users/8f1c43cdf9824397af31a830b6ee2892 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:03.029805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.031119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.045075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10208e026095483b8d527560b319874c', 'request_id': 'req-f386bca5-84e5-4b93-aabd-4058724c44bf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.051279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10208e026095483b8d527560b319874c', 'request_id': 'req-f386bca5-84e5-4b93-aabd-4058724c44bf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.097312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe4bc-d1e1-429a-8b03-cd33ff26b9f8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.129814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10208e026095483b8d527560b319874c', 'request_id': 'req-f386bca5-84e5-4b93-aabd-4058724c44bf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.137877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:03.141550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] The token cache is being invalidate because project 10208e026095483b8d527560b319874c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:03.141962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.142647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f386bca5-84e5-4b93-aabd-4058724c44bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.144290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1021/2037] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:02 2022] DELETE /identity/v3/projects/10208e026095483b8d527560b319874c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:03.145617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ef557-ab40-4d65-b2b9-be40a0324a0f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.152655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ef557-ab40-4d65-b2b9-be40a0324a0f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.152655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ef557-ab40-4d65-b2b9-be40a0324a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.153085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.153952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.154239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.154517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] PATH_INFO: `/v3/projects/894cff7b9106408bb865f52debd2b2dd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.155707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=894cff7b9106408bb865f52debd2b2dd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.158224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.165613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b01ef557-ab40-4d65-b2b9-be40a0324a0f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:03.167021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b01ef557-ab40-4d65-b2b9-be40a0324a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.176265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1022/2038] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:03.176822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.177102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.177380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.196288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:03.197600 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.205661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1023/2039] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:03.206437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.207627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.263294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398e31-4f51-4acc-a11d-7b1b53b97ff5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.267489 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f7997-73c6-4400-8046-f2306f1ea56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.268152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7997-73c6-4400-8046-f2306f1ea56e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.268480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7997-73c6-4400-8046-f2306f1ea56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.268759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7997-73c6-4400-8046-f2306f1ea56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.277944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f7997-73c6-4400-8046-f2306f1ea56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.279402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f7997-73c6-4400-8046-f2306f1ea56e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.289462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1024/2040] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:03.290767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d00b6e-b952-41c7-80ef-e47d2b7a3e7f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.291060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d00b6e-b952-41c7-80ef-e47d2b7a3e7f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.291342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d00b6e-b952-41c7-80ef-e47d2b7a3e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.309265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-78d00b6e-b952-41c7-80ef-e47d2b7a3e7f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:03.310471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-78d00b6e-b952-41c7-80ef-e47d2b7a3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.318800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1025/2041] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:03.324678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d00b6e-b952-41c7-80ef-e47d2b7a3e7f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.332442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d00b6e-b952-41c7-80ef-e47d2b7a3e7f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.337188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.337840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.338119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.338395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.339119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:03.339425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.341070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.353891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1026/2042] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:20:03.358494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.364796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:03.371758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0e5f-3c76-4dbf-befb-a02a222c0dd3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.378949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894cff7b9106408bb865f52debd2b2dd', 'request_id': 'req-61ad0ae1-bb40-43ba-834b-c9844e06ee26'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.432295 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.433167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.433445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.433719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.434400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.436358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.473027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894cff7b9106408bb865f52debd2b2dd', 'request_id': 'req-61ad0ae1-bb40-43ba-834b-c9844e06ee26'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.479775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894cff7b9106408bb865f52debd2b2dd', 'request_id': 'req-61ad0ae1-bb40-43ba-834b-c9844e06ee26'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.490085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] The token cache is being invalidate because project 894cff7b9106408bb865f52debd2b2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:03.490374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.491018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61ad0ae1-bb40-43ba-834b-c9844e06ee26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:03.492614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1017/2043] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:03 2022] DELETE /identity/v3/projects/894cff7b9106408bb865f52debd2b2dd => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:03.497211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a2b3-dcdc-49a7-abf0-f017b2409a87 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.497497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a2b3-dcdc-49a7-abf0-f017b2409a87 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.497773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a2b3-dcdc-49a7-abf0-f017b2409a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.517582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8958a2b3-dcdc-49a7-abf0-f017b2409a87 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:03.518782 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8958a2b3-dcdc-49a7-abf0-f017b2409a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.526840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1018/2044] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:03.535397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.535679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.535962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.553873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:03.555106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.564696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1019/2045] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:03.569329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1027/2046] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:03.570480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.570982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.573965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.594243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d6185-b6c2-4594-8604-ffe4954952d8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.670792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.671618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.672011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.673811 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.675274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.676989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033cebd-cdc6-4ab4-92c8-8701ebabf882 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.677989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.696929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.697632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.697989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.698321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.699079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:03.699394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.701045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.724569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1028/2047] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:20:03.729706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.740248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80afe-7625-4310-a95e-e7a79b08ca37 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.745033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.745715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.746055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.746264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.747112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.749663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.804023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1020/2048] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:03.808252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.818983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87363c0-d11c-44ba-a2c8-2128836e3a67 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.823768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.824468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.824756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.825041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.825804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.827426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.839531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1021/2049] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:03.843372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.854377 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e9ac0-7c7f-422f-810f-bb8e6efd42f2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.860078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.861011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.861298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.861574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.862307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.863910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.874591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1022/2050] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:03.881476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.893930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f7424-33ae-4d57-a08a-26931a821d1f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.898805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.899733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.900345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.900629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] PATH_INFO: `/v3/projects/acaa2b3893014c3492ff2caed186de83/users/78f425e314fc44e483cb392facf236da/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.914346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1029/2051] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:03 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:03.914346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:03.914346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:03.925160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaa2b3893014c3492ff2caed186de83, user_id=78f425e314fc44e483cb392facf236da, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.928067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:03.982945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4156-f292-4175-89b0-4b3ecd7dbc36 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:03.988369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:03.990564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:03.990564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:03.990564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] PATH_INFO: `/v3/projects/a5ed895d8ac44e6a8a054e134442af81` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:03.990988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ed895d8ac44e6a8a054e134442af81)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:03.992972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.022615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1023/2052] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:03 2022] PUT /identity/v3/projects/acaa2b3893014c3492ff2caed186de83/users/78f425e314fc44e483cb392facf236da/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:04.023440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.031819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:04.089269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e26ea-934a-4443-9ba7-2e511eae49f7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.094649 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88239-6fb9-4b32-b5fd-0316816b8a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.095862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88239-6fb9-4b32-b5fd-0316816b8a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.096141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88239-6fb9-4b32-b5fd-0316816b8a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.096449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88239-6fb9-4b32-b5fd-0316816b8a06 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.097181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88239-6fb9-4b32-b5fd-0316816b8a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.099082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88239-6fb9-4b32-b5fd-0316816b8a06 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.141894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ed895d8ac44e6a8a054e134442af81', 'request_id': 'req-98e5f751-f972-4322-9539-d3f94517f95a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:04.148440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:04.149200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ed895d8ac44e6a8a054e134442af81', 'request_id': 'req-98e5f751-f972-4322-9539-d3f94517f95a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:04.219435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1024/2053] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:04.219435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0ca6-6c42-4081-b404-13574d55f05d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.219435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0ca6-6c42-4081-b404-13574d55f05d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.219435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0ca6-6c42-4081-b404-13574d55f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.243691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-137c0ca6-6c42-4081-b404-13574d55f05d None None] MFA Rules not processed for user `78f425e314fc44e483cb392facf236da`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:04.244944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-137c0ca6-6c42-4081-b404-13574d55f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:04.250445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ed895d8ac44e6a8a054e134442af81', 'request_id': 'req-98e5f751-f972-4322-9539-d3f94517f95a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:04.262671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] The token cache is being invalidate because project a5ed895d8ac44e6a8a054e134442af81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:04.263135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:04.263610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:04.265182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1030/2054] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:03 2022] DELETE /identity/v3/projects/a5ed895d8ac44e6a8a054e134442af81 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:04.265941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.267771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:04.314022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1025/2055] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:04.315807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.316340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.316622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.334635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:04.335828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:04.340149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5f751-f972-4322-9539-d3f94517f95a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.345222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1026/2056] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:04.346178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.347602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:04.351550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b32e9-bc67-4808-91f8-d79752869408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.358844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b32e9-bc67-4808-91f8-d79752869408 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.358844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b32e9-bc67-4808-91f8-d79752869408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.358844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b32e9-bc67-4808-91f8-d79752869408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.358844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b32e9-bc67-4808-91f8-d79752869408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.358844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b32e9-bc67-4808-91f8-d79752869408 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.369197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1031/2057] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:04.369197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b89d0-3e6a-4299-bb18-6a5d913666fb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.369197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b89d0-3e6a-4299-bb18-6a5d913666fb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.369197 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b89d0-3e6a-4299-bb18-6a5d913666fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.388220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-de3b89d0-3e6a-4299-bb18-6a5d913666fb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:04.389438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-de3b89d0-3e6a-4299-bb18-6a5d913666fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:04.398784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1032/2058] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:04.399504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b89d0-3e6a-4299-bb18-6a5d913666fb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.409540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b89d0-3e6a-4299-bb18-6a5d913666fb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.413935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e3af-948f-482d-8830-a3cfad61fa3f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.413935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.414161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.414373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.414652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.414766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.414916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.415009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.415291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.416046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.417708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.425882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.427355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.428708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1033/2059] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:04.429510 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.436869 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1027/2060] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:04.437639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.441790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403d369-e8b5-4679-977c-7d1c611f8528 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.447405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.448137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.454269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6851-ec0b-4d3e-90df-13c9f0489823 service glance] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.454404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.454404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.454404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:04.454404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.454404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.454786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.454786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.454786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.455099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] PATH_INFO: `/v3/projects/df67a7ef0a834eb9a3961a5cc8ec50e8/users/88a229fffa45449c93bdb9b1e2410d7e/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.466527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1034/2061] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:20:04.471907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df67a7ef0a834eb9a3961a5cc8ec50e8, user_id=88a229fffa45449c93bdb9b1e2410d7e, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.472346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.474553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.479503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:04.482973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9613407-0d8a-4cc0-b845-451b93d830bf admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.489228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07262e8d-5817-48bd-9b39-16c23ed81afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.490421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262e8d-5817-48bd-9b39-16c23ed81afa admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.490975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262e8d-5817-48bd-9b39-16c23ed81afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.491376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262e8d-5817-48bd-9b39-16c23ed81afa admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.492294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07262e8d-5817-48bd-9b39-16c23ed81afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.494209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07262e8d-5817-48bd-9b39-16c23ed81afa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.601467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1028/2062] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:04 2022] PUT /identity/v3/projects/df67a7ef0a834eb9a3961a5cc8ec50e8/users/88a229fffa45449c93bdb9b1e2410d7e/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:04.604830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1035/2063] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:04.609971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.612992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad876-9516-4e17-acc6-9c6275b3bb91 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.613284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad876-9516-4e17-acc6-9c6275b3bb91 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.613567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad876-9516-4e17-acc6-9c6275b3bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.644252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-91cad876-9516-4e17-acc6-9c6275b3bb91 None None] MFA Rules not processed for user `88a229fffa45449c93bdb9b1e2410d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:04.645530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-91cad876-9516-4e17-acc6-9c6275b3bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:04.670332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:04.685109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0855-6648-45d3-b997-9adcb866b174 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.724490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1036/2064] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:04.729748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad876-9516-4e17-acc6-9c6275b3bb91 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.748745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.749785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.749945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.750236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.751020 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.753522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.797242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad876-9516-4e17-acc6-9c6275b3bb91 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.801914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.802637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.802933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.803212 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.803898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.805856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.837334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1029/2065] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:04.841348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.851914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa1f54-9d3e-490f-8937-8499661dfaa2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.856690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.857333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.857625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.857895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.858698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.860437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.872742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1030/2066] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:04.876688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.888062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65bb0f-585e-46b7-9894-6b10a589ebae admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:04.891221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:04.892404 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:04.892843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:04.893119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:04.893876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:04.895470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:04.908035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1031/2067] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:04.912659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.919224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1037/2068] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:04.920827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:04.925818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2846bd8-35c6-4559-922b-fb67b4890865 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.001290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.002193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.002473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.002833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] PATH_INFO: `/v3/projects/432ff4dfb4b240c097681d905c2dcc8f/users/c699081f0e2249e2b9e36f6398aa4a88/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.006230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6b6b-040b-42f4-9ee5-229320ad6132 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.011822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab65538-59d3-4bdb-a9e6-371314ee20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.013730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab65538-59d3-4bdb-a9e6-371314ee20de admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.013730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab65538-59d3-4bdb-a9e6-371314ee20de admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.013730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab65538-59d3-4bdb-a9e6-371314ee20de admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.013958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab65538-59d3-4bdb-a9e6-371314ee20de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.015811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab65538-59d3-4bdb-a9e6-371314ee20de admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.020582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=432ff4dfb4b240c097681d905c2dcc8f, user_id=c699081f0e2249e2b9e36f6398aa4a88, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.023634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.026753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:05.135976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1032/2069] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:04 2022] PUT /identity/v3/projects/432ff4dfb4b240c097681d905c2dcc8f/users/c699081f0e2249e2b9e36f6398aa4a88/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:05.136378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1038/2070] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:04 2022] POST /identity/v3/users => generated 308 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:05.140258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:05.147917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.148231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.148523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.176949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] MFA Rules not processed for user `c699081f0e2249e2b9e36f6398aa4a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:05.178213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:05.208050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5deae-c306-4e0e-a7b9-99e164ced80a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.211679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:05.213199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.219000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.219000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.219000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.219000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.219000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.227338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1033/2071] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:05.231604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:05.242065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730c4d-5401-406b-8433-acdc9ec301b5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.247468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.248392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.248678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.251303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] PATH_INFO: `/v3/projects/e24eaf7fa64d42e285bf16aa3c1e9272/users/8ee2b42981d14333a528725c04412329/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.253393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1039/2072] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:05.264629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24eaf7fa64d42e285bf16aa3c1e9272, user_id=8ee2b42981d14333a528725c04412329, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.268055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.289043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:05.290905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:05.351783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fd3b8-e2cd-4a50-9fb0-0752107c4476 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.353002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1034/2073] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:05 2022] PUT /identity/v3/projects/e24eaf7fa64d42e285bf16aa3c1e9272/users/8ee2b42981d14333a528725c04412329/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:05.356832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:05.404163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.404578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.404863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.405146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.424017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bc866-42b1-4be6-be7e-210bc31de00b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.429880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.430555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.430842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.431121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.431983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.433896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.447366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1035/2074] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:05.451972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:05.473955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a652a-cb01-4822-8700-ec48b7570c16 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.491989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca269f-2a70-486b-8fe2-5477d4a3d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.492931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca269f-2a70-486b-8fe2-5477d4a3d1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.493218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca269f-2a70-486b-8fe2-5477d4a3d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.493764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca269f-2a70-486b-8fe2-5477d4a3d1bf admin admin] PATH_INFO: `/v3/projects/e24eaf7fa64d42e285bf16aa3c1e9272/users/8ee2b42981d14333a528725c04412329/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.495793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca269f-2a70-486b-8fe2-5477d4a3d1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24eaf7fa64d42e285bf16aa3c1e9272, user_id=8ee2b42981d14333a528725c04412329, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.499005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca269f-2a70-486b-8fe2-5477d4a3d1bf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.514340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.515781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1036/2075] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:05 2022] PUT /identity/v3/projects/e24eaf7fa64d42e285bf16aa3c1e9272/users/8ee2b42981d14333a528725c04412329/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:05.515922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.527083 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7fa8b-82b4-4603-9e15-098d67d79a86 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.527374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7fa8b-82b4-4603-9e15-098d67d79a86 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.527656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7fa8b-82b4-4603-9e15-098d67d79a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.530217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1040/2076] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:05.558836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-24d7fa8b-82b4-4603-9e15-098d67d79a86 None None] MFA Rules not processed for user `8ee2b42981d14333a528725c04412329`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:05.560858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-24d7fa8b-82b4-4603-9e15-098d67d79a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:05.621946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:05.651005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1037/2077] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:05.663598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:05.666216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:05.679081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa3150-c57c-41e5-ba1b-86b14177f51a service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:05.721340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:05.738562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b160f8-c280-406f-9724-e1e3efaed268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:05.747956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b160f8-c280-406f-9724-e1e3efaed268 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:05.747956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b160f8-c280-406f-9724-e1e3efaed268 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:05.747956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b160f8-c280-406f-9724-e1e3efaed268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:05.749576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b160f8-c280-406f-9724-e1e3efaed268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:05.751658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b160f8-c280-406f-9724-e1e3efaed268 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:05.761932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1041/2078] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:05.987285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7fa8b-82b4-4603-9e15-098d67d79a86 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:06.069105 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7fa8b-82b4-4603-9e15-098d67d79a86 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:06.082266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:06.083213 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:06.083495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:06.083804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] PATH_INFO: `/v3/users/88a229fffa45449c93bdb9b1e2410d7e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:06.085024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a229fffa45449c93bdb9b1e2410d7e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:06.087018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:06.372988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a229fffa45449c93bdb9b1e2410d7e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.381832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a229fffa45449c93bdb9b1e2410d7e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.382723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a229fffa45449c93bdb9b1e2410d7e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.383700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a229fffa45449c93bdb9b1e2410d7e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.404312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a229fffa45449c93bdb9b1e2410d7e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.502096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1038/2079] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:05 2022] DELETE /identity/v3/users/88a229fffa45449c93bdb9b1e2410d7e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:06.506766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:06.507257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:06.507477 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:06.527362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:06.533196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:06.562774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:06.564617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:06.619755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1042/2080] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:06.630190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:06.631548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:06.634073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:06.648329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad97691-2593-40a3-9c61-8265f78391c6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:06.653499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:06.654413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:06.654698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:06.654991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] PATH_INFO: `/v3/users/a79b35ced6ab4d2e9c9784d33e8b4aa7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:06.656218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79b35ced6ab4d2e9c9784d33e8b4aa7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:06.658243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:06.706992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd677443-95af-4f0c-8aa4-f698759b7ae7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:06.710718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b3140-02a8-44cb-98bc-982122ff4322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:06.711393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3140-02a8-44cb-98bc-982122ff4322 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:06.711679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3140-02a8-44cb-98bc-982122ff4322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:06.711959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3140-02a8-44cb-98bc-982122ff4322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:06.721685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b3140-02a8-44cb-98bc-982122ff4322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:06.723148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b3140-02a8-44cb-98bc-982122ff4322 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:06.732974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1043/2081] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:06.915016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79b35ced6ab4d2e9c9784d33e8b4aa7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.921935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79b35ced6ab4d2e9c9784d33e8b4aa7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.922606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79b35ced6ab4d2e9c9784d33e8b4aa7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.923340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79b35ced6ab4d2e9c9784d33e8b4aa7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:06.935374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79b35ced6ab4d2e9c9784d33e8b4aa7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.044281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1039/2082] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:06 2022] DELETE /identity/v3/users/a79b35ced6ab4d2e9c9784d33e8b4aa7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:07.049545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:07.049838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:07.050122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:07.069029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:07.070271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:07.133176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1044/2083] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:07.142771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:07.144243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:07.199232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:07.201437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:07.214571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4fe8-082f-48ee-bd39-18b680a4d266 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:07.218576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7f312-66f1-4438-930d-9edb8c446f82 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:07.219586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:07.220618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:07.220899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:07.221178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] PATH_INFO: `/v3/projects/df67a7ef0a834eb9a3961a5cc8ec50e8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:07.222443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df67a7ef0a834eb9a3961a5cc8ec50e8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:07.223747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d9664-88cb-4f36-b138-a1072e7318ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:07.224719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:07.225504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9664-88cb-4f36-b138-a1072e7318ba service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:07.225921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9664-88cb-4f36-b138-a1072e7318ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:07.230870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9664-88cb-4f36-b138-a1072e7318ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:07.240508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d9664-88cb-4f36-b138-a1072e7318ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:07.242246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d9664-88cb-4f36-b138-a1072e7318ba service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:07.253659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:07.254260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1040/2084] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:07.362155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df67a7ef0a834eb9a3961a5cc8ec50e8', 'request_id': 'req-711f5b78-712c-49bd-8ae8-5d844280e020'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.369910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df67a7ef0a834eb9a3961a5cc8ec50e8', 'request_id': 'req-711f5b78-712c-49bd-8ae8-5d844280e020'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.389139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252c789-9694-45d9-838f-9514043308f1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:07.389431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252c789-9694-45d9-838f-9514043308f1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:07.389735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252c789-9694-45d9-838f-9514043308f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:07.408411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1252c789-9694-45d9-838f-9514043308f1 None None] MFA Rules not processed for user `c699081f0e2249e2b9e36f6398aa4a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:07.409626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1252c789-9694-45d9-838f-9514043308f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:07.446783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df67a7ef0a834eb9a3961a5cc8ec50e8', 'request_id': 'req-711f5b78-712c-49bd-8ae8-5d844280e020'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.473465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] The token cache is being invalidate because project df67a7ef0a834eb9a3961a5cc8ec50e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:07.473798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.474770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.476662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1045/2085] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:07 2022] DELETE /identity/v3/projects/df67a7ef0a834eb9a3961a5cc8ec50e8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:07.481689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1041/2086] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:07.484187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:07.487867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:07.581752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5b78-712c-49bd-8ae8-5d844280e020 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:07.589136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:07.589926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:07.590213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:07.590495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] PATH_INFO: `/v3/users/8ee2b42981d14333a528725c04412329` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:07.591766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee2b42981d14333a528725c04412329)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:07.593738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:07.795585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee2b42981d14333a528725c04412329'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.809094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee2b42981d14333a528725c04412329'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.817317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee2b42981d14333a528725c04412329'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.818046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee2b42981d14333a528725c04412329'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.847384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252c789-9694-45d9-838f-9514043308f1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:07.849071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1252c789-9694-45d9-838f-9514043308f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:07.863914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252c789-9694-45d9-838f-9514043308f1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:07.869186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:07.869957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:07.870231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:07.870684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] PATH_INFO: `/v3/projects/8ca6e214b2e1451cafacefdec3259a15` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:07.871891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca6e214b2e1451cafacefdec3259a15)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:07.873828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:07.893938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:07.896300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9010a73e-0208-46ce-8b4c-840555e909e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee2b42981d14333a528725c04412329'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:07.907516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1046/2087] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:07 2022] DELETE /identity/v3/users/8ee2b42981d14333a528725c04412329 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:08.085629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca6e214b2e1451cafacefdec3259a15', 'request_id': 'req-64169887-8301-4628-9f20-36ee2d0e853a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.187998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca6e214b2e1451cafacefdec3259a15', 'request_id': 'req-64169887-8301-4628-9f20-36ee2d0e853a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.195853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca6e214b2e1451cafacefdec3259a15', 'request_id': 'req-64169887-8301-4628-9f20-36ee2d0e853a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.227844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] The token cache is being invalidate because project 8ca6e214b2e1451cafacefdec3259a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:08.229455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.229455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-64169887-8301-4628-9f20-36ee2d0e853a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.234778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1042/2088] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:07 2022] DELETE /identity/v3/projects/8ca6e214b2e1451cafacefdec3259a15 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:08.237064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c5c11-a73b-41d6-ae09-3ab8a3201fbe None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.237352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c5c11-a73b-41d6-ae09-3ab8a3201fbe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.237652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c5c11-a73b-41d6-ae09-3ab8a3201fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.259992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7a9c5c11-a73b-41d6-ae09-3ab8a3201fbe None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:08.260347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7a9c5c11-a73b-41d6-ae09-3ab8a3201fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:08.292904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:08.338406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1047/2089] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:08.350398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.350398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.350398 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.367069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:08.368305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:08.378174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1043/2090] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:08.382553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c5c11-a73b-41d6-ae09-3ab8a3201fbe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.386426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.388496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:08.397649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c5c11-a73b-41d6-ae09-3ab8a3201fbe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.401607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a50c-fbc9-4a02-83f8-d8bdc19cb116 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.405376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.406054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.406341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.406753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.407988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:08.408351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.410196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.422161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.423077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.423745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.423745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] PATH_INFO: `/v3/projects/e24eaf7fa64d42e285bf16aa3c1e9272` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.424849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24eaf7fa64d42e285bf16aa3c1e9272)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.429404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1048/2091] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:20:08.429537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.430416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.442725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d8d86-0637-4f35-935c-e8328ef6dd1a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.447629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.448444 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.448821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.449161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.449921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.451939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.565437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24eaf7fa64d42e285bf16aa3c1e9272', 'request_id': 'req-1729bc05-f011-4039-879c-895d9634224a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.588396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1049/2092] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:08.590429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.633274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24eaf7fa64d42e285bf16aa3c1e9272', 'request_id': 'req-1729bc05-f011-4039-879c-895d9634224a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.640369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24eaf7fa64d42e285bf16aa3c1e9272', 'request_id': 'req-1729bc05-f011-4039-879c-895d9634224a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.652357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] The token cache is being invalidate because project e24eaf7fa64d42e285bf16aa3c1e9272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:08.652751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.653516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1729bc05-f011-4039-879c-895d9634224a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:08.655258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1044/2093] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:08 2022] DELETE /identity/v3/projects/e24eaf7fa64d42e285bf16aa3c1e9272 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:08.659813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320d5ba-22bf-4d46-9289-41178a7dd000 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.661875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ad7a-1634-46f3-9013-62e202430174 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.662168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ad7a-1634-46f3-9013-62e202430174 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.662457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ad7a-1634-46f3-9013-62e202430174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.668375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.670436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.670783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.676261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.677679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.679969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.700364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0107ad7a-1634-46f3-9013-62e202430174 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:08.700364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0107ad7a-1634-46f3-9013-62e202430174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:08.713302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1045/2094] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:08.725252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f267f3-c319-46e6-b04a-77b1c77edee0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.725252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f267f3-c319-46e6-b04a-77b1c77edee0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.725252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f267f3-c319-46e6-b04a-77b1c77edee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.743953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-75f267f3-c319-46e6-b04a-77b1c77edee0 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:08.746622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-75f267f3-c319-46e6-b04a-77b1c77edee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:08.755000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1046/2095] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:08.759092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f267f3-c319-46e6-b04a-77b1c77edee0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.770233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f267f3-c319-46e6-b04a-77b1c77edee0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.775429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.776078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.776387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.776664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.777390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:08.777692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.779279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.792921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1047/2096] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:20:08.794366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1050/2097] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:08.798971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.800390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.801056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:08.813146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8d63f-e70a-4c59-a180-916b9ec90fad admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.817385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e7ccc-0ee6-4f0f-9e3e-2c3cf7169d03 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.822516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.822676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.823387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.823675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.823820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.824152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.824427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.824845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.825717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.828753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.829410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.829614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.843687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1048/2098] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:08.851668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.865152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d3725-a8e3-4359-89e8-d37021568c5b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.870757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.871429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.871710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.871991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.872770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.874371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.889233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1049/2099] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:08.890967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:08.902387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6a0b-e357-4baf-8fbb-c8498518aff5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:08.907302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d2c5f-3ffe-44ac-9550-d2327c5b6a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:08.908222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2c5f-3ffe-44ac-9550-d2327c5b6a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:08.908511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2c5f-3ffe-44ac-9550-d2327c5b6a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:08.908787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d2c5f-3ffe-44ac-9550-d2327c5b6a32 admin admin] PATH_INFO: `/v3/projects/9170777eb80e46bd9d8ea3a576a9678c/users/01fe8c57517d4ca5958ec13139aa2b74/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:08.924709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d2c5f-3ffe-44ac-9550-d2327c5b6a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9170777eb80e46bd9d8ea3a576a9678c, user_id=01fe8c57517d4ca5958ec13139aa2b74, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:08.927626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d2c5f-3ffe-44ac-9550-d2327c5b6a32 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:08.963743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1051/2100] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:08.964925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:09.030648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958bcfc-c24d-4c47-9a04-4502c9e54d7f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:09.035882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:09.036590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.036875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.037156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.037875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:09.039791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:09.082233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1050/2101] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:08 2022] PUT /identity/v3/projects/9170777eb80e46bd9d8ea3a576a9678c/users/01fe8c57517d4ca5958ec13139aa2b74/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:09.088452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.089063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.089410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.102574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:09.108835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:09.110221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:09.173330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1051/2102] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:09.196160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1052/2103] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:08 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:09.200836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:09.200994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:09.201085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:09.213086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548fb41-4b29-4e83-9d45-13b365cc6e9c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:09.218460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:09.219122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.219407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.219852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.220504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:09.222561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:09.239460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1053/2104] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:09.243395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:09.255483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d9ed7-c746-4554-93af-a9b308ed0fc6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:09.260515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:09.261196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.261482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.261763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.262508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:09.264128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:09.276952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1054/2105] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:09.281439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:09.294483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5391-354d-4d88-aeac-71428cfb4cdd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:09.294577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7bb1b-f7a1-4957-b536-0f79bef766d9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:09.302891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365032b5-f4bb-4a5e-aacf-26f44130d6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:09.303662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365032b5-f4bb-4a5e-aacf-26f44130d6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.303947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365032b5-f4bb-4a5e-aacf-26f44130d6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.304255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365032b5-f4bb-4a5e-aacf-26f44130d6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.305114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:09.306226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.306667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.307226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] PATH_INFO: `/v3/projects/38379f99e8034e49814971e302cab588/users/92dd61d6bbfb45018f1da1a314323e8b/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.316056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365032b5-f4bb-4a5e-aacf-26f44130d6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:09.318141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365032b5-f4bb-4a5e-aacf-26f44130d6c9 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:09.326050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38379f99e8034e49814971e302cab588, user_id=92dd61d6bbfb45018f1da1a314323e8b, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:09.328941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:09.332957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1052/2106] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:09.446696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1055/2107] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:09 2022] PUT /identity/v3/projects/38379f99e8034e49814971e302cab588/users/92dd61d6bbfb45018f1da1a314323e8b/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:09.456923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92acf0-1ee4-4af6-95ae-fd39e5bf679b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.457211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92acf0-1ee4-4af6-95ae-fd39e5bf679b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.457510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92acf0-1ee4-4af6-95ae-fd39e5bf679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.490323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4b92acf0-1ee4-4af6-95ae-fd39e5bf679b None None] MFA Rules not processed for user `92dd61d6bbfb45018f1da1a314323e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:09.491606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b92acf0-1ee4-4af6-95ae-fd39e5bf679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:09.563995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1053/2108] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:09.568632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:09.641432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eebef-84b5-4a7b-9004-f18213a38a87 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:09.646445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:09.647099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.647401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.647710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.648442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:09.650356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:09.775807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1056/2109] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:09 2022] POST /identity/v3/projects => generated 369 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:09.778940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92acf0-1ee4-4af6-95ae-fd39e5bf679b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:09.790753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92acf0-1ee4-4af6-95ae-fd39e5bf679b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:09.847443 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:09.848110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:09.848416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:09.848689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:09.849414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:09.851320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:09.929046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:09.998001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1054/2110] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:09 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:09.998791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:10.017669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36d009-f2d5-4e3d-969b-8cd4f705c54b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:10.024422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:10.024422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:10.024422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:10.024422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:10.025254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:10.026943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:10.047571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:10.050351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1057/2111] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:10.060797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1786ff1-e936-471c-a52c-4b9eaf1c1f21 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:10.066169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:10.067571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:10.067859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:10.068139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] PATH_INFO: `/v3/projects/74e4a10a5a154339ad0d489efc876081/users/311c7665160949fc8bc8f2bf5b2f2ca1/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:10.085765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e4a10a5a154339ad0d489efc876081, user_id=311c7665160949fc8bc8f2bf5b2f2ca1, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:10.089762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:10.227227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1055/2112] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:10 2022] PUT /identity/v3/projects/74e4a10a5a154339ad0d489efc876081/users/311c7665160949fc8bc8f2bf5b2f2ca1/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:10.231333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:10.242240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96a95-a183-49ad-8817-ce00461f9e55 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:10.315274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e836-a0a6-4be2-83c5-09ce9a0671b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:10.315957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e836-a0a6-4be2-83c5-09ce9a0671b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:10.316296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e836-a0a6-4be2-83c5-09ce9a0671b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:10.316775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e836-a0a6-4be2-83c5-09ce9a0671b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:10.317359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748e836-a0a6-4be2-83c5-09ce9a0671b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:10.319270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748e836-a0a6-4be2-83c5-09ce9a0671b9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:10.334828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1058/2113] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:10.339017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:10.351347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772f82e-25b4-44f1-914a-b4594e1d5fcc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:10.356763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:10.357688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:10.357977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:10.358647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] PATH_INFO: `/v3/projects/74e4a10a5a154339ad0d489efc876081/users/311c7665160949fc8bc8f2bf5b2f2ca1/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:10.361022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e4a10a5a154339ad0d489efc876081, user_id=311c7665160949fc8bc8f2bf5b2f2ca1, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:10.363914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:10.374661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1056/2114] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:10 2022] PUT /identity/v3/projects/74e4a10a5a154339ad0d489efc876081/users/311c7665160949fc8bc8f2bf5b2f2ca1/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:10.386769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaafb00-b073-488c-a217-61d23472ebaa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:10.387085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaafb00-b073-488c-a217-61d23472ebaa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:10.387400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaafb00-b073-488c-a217-61d23472ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:10.421579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-aaaafb00-b073-488c-a217-61d23472ebaa None None] MFA Rules not processed for user `311c7665160949fc8bc8f2bf5b2f2ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:10.423388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aaaafb00-b073-488c-a217-61d23472ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:10.499762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1059/2115] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:10.507343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:10.509171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:10.574136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17b3f-49ac-494e-ba97-912060405006 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:10.577937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0bc8-b6c0-4baa-b42b-e108ba3f351a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:10.578647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0bc8-b6c0-4baa-b42b-e108ba3f351a service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:10.578968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0bc8-b6c0-4baa-b42b-e108ba3f351a service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:10.579661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0bc8-b6c0-4baa-b42b-e108ba3f351a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:10.581623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:10.591581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0bc8-b6c0-4baa-b42b-e108ba3f351a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:10.593336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0bc8-b6c0-4baa-b42b-e108ba3f351a service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:10.604748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1057/2116] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:10.846083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:14.551123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaafb00-b073-488c-a217-61d23472ebaa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:14.715513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaafb00-b073-488c-a217-61d23472ebaa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:14.731478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:14.732622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:14.736378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:14.736714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] PATH_INFO: `/v3/users/92dd61d6bbfb45018f1da1a314323e8b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:14.742118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92dd61d6bbfb45018f1da1a314323e8b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:14.748957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:15.090976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92dd61d6bbfb45018f1da1a314323e8b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:15.121593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92dd61d6bbfb45018f1da1a314323e8b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:15.132823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92dd61d6bbfb45018f1da1a314323e8b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:15.133579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92dd61d6bbfb45018f1da1a314323e8b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:15.227883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92dd61d6bbfb45018f1da1a314323e8b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:15.241053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:15.241615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:15.241615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:15.243047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1060/2117] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:14 2022] DELETE /identity/v3/users/92dd61d6bbfb45018f1da1a314323e8b => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:15.263037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:15.264847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:15.351034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1058/2118] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:15.361018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:15.362707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:15.389621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:15.475154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d2bd3-1bcf-4920-92f6-7e139c987176 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:15.484054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:15.485887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:15.486133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:15.486410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:15.497402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:15.499140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:15.510869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1061/2119] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:16.198336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:16.200072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:16.222432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fdcb8-2d6a-41db-8ee4-487bea85ea05 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:16.244008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:16.244906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:16.245185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:16.245459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] PATH_INFO: `/v3/projects/38379f99e8034e49814971e302cab588` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:16.246792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38379f99e8034e49814971e302cab588)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:16.249335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:16.348510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:16.386486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38379f99e8034e49814971e302cab588', 'request_id': 'req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.466848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38379f99e8034e49814971e302cab588', 'request_id': 'req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.475566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38379f99e8034e49814971e302cab588', 'request_id': 'req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.490669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] The token cache is being invalidate because project 38379f99e8034e49814971e302cab588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:16.491017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.492078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a0f53d80-8ac8-4ff6-a6a8-985489db8cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.495496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1059/2120] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:16 2022] DELETE /identity/v3/projects/38379f99e8034e49814971e302cab588 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:16.499509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:16.511412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e45941-258f-45fb-9f07-22fc04fcc0e9 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:16.615121 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:16.616100 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:16.616567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:16.616928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] PATH_INFO: `/v3/users/311c7665160949fc8bc8f2bf5b2f2ca1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:16.618326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=311c7665160949fc8bc8f2bf5b2f2ca1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:16.620451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:16.859037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311c7665160949fc8bc8f2bf5b2f2ca1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.876504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311c7665160949fc8bc8f2bf5b2f2ca1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.888670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311c7665160949fc8bc8f2bf5b2f2ca1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.889918 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311c7665160949fc8bc8f2bf5b2f2ca1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.987021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311c7665160949fc8bc8f2bf5b2f2ca1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:16.996769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1062/2121] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:16 2022] DELETE /identity/v3/users/311c7665160949fc8bc8f2bf5b2f2ca1 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:17.235769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cbd69-67ef-4290-b998-9976ddeb84c7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:17.235769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cbd69-67ef-4290-b998-9976ddeb84c7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:17.236082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cbd69-67ef-4290-b998-9976ddeb84c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:17.264932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ec0cbd69-67ef-4290-b998-9976ddeb84c7 None None] MFA Rules not processed for user `01fe8c57517d4ca5958ec13139aa2b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:17.266184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ec0cbd69-67ef-4290-b998-9976ddeb84c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:17.342304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1060/2122] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:17.346970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:17.349447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:17.403642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:17.437004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887673c-3cb9-41a8-b1ab-c8034f94edd5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:17.444094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:17.445223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:17.445894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:17.446828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:17.447562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:17.450068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:17.617458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1063/2123] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:17 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:17.618642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cbd69-67ef-4290-b998-9976ddeb84c7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:17.636827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cbd69-67ef-4290-b998-9976ddeb84c7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:17.643897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:17.645692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:17.729043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:17.730143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:17.731722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:17.732357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:17.733280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:17.735695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:17.796536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f270-6f51-4170-bec3-03ed23173cd5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:17.801711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:17.802589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:17.802872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:17.803149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] PATH_INFO: `/v3/projects/74e4a10a5a154339ad0d489efc876081` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:17.805540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e4a10a5a154339ad0d489efc876081)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:17.807226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:17.853062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1061/2124] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:17 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:17.857648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:17.872989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cfab-8706-4a87-8836-22f182e4d1d7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:17.879688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:17.880412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:17.881379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:17.881379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:17.883455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:17.883691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:17.896692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1062/2125] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:17.901643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:17.923890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfdfe2-69ef-438f-9dae-94334446f7a5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:17.936221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:17.937508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:17.937976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:17.939025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] PATH_INFO: `/v3/projects/de525ebdfc9346a69d911aa830b98049/users/e6736929ec2f4da3aecb614d6048794d/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:17.961025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de525ebdfc9346a69d911aa830b98049, user_id=e6736929ec2f4da3aecb614d6048794d, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:17.963756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:18.112515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1063/2126] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:17 2022] PUT /identity/v3/projects/de525ebdfc9346a69d911aa830b98049/users/e6736929ec2f4da3aecb614d6048794d/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:18.113629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:18.118700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:18.124919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e4a10a5a154339ad0d489efc876081', 'request_id': 'req-82227f1f-eb2f-461f-a9bf-613f2d3da077'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:18.133431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e4a10a5a154339ad0d489efc876081', 'request_id': 'req-82227f1f-eb2f-461f-a9bf-613f2d3da077'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:18.199725 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee31b2-362a-47f9-a52f-fe2a44136c28 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:18.214989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e4a10a5a154339ad0d489efc876081', 'request_id': 'req-82227f1f-eb2f-461f-a9bf-613f2d3da077'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:18.242340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] The token cache is being invalidate because project 74e4a10a5a154339ad0d489efc876081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:18.242659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:18.243373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-82227f1f-eb2f-461f-a9bf-613f2d3da077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:18.245598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1064/2127] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:17 2022] DELETE /identity/v3/projects/74e4a10a5a154339ad0d489efc876081 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:18.257292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735134cd-8f29-4f6c-a0f2-1304e071a40e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.259441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735134cd-8f29-4f6c-a0f2-1304e071a40e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.259842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735134cd-8f29-4f6c-a0f2-1304e071a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.275992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:18.276595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.276692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.276912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.277834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:18.279635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:18.283989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-735134cd-8f29-4f6c-a0f2-1304e071a40e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:18.285746 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-735134cd-8f29-4f6c-a0f2-1304e071a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:18.290861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1064/2128] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:18.295280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:18.307909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:18.312025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1065/2129] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:18.321416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eecb4d-124b-47fd-90ad-aa3ad8a8ad46 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.321872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eecb4d-124b-47fd-90ad-aa3ad8a8ad46 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.323120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eecb4d-124b-47fd-90ad-aa3ad8a8ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.330460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f3045-ebab-4491-83cb-8ec12b0baee6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:18.335342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:18.336277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.336560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.336833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] PATH_INFO: `/v3/projects/de525ebdfc9346a69d911aa830b98049/users/e6736929ec2f4da3aecb614d6048794d/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.339537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de525ebdfc9346a69d911aa830b98049, user_id=e6736929ec2f4da3aecb614d6048794d, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:18.342272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:18.358475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1065/2130] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:18 2022] PUT /identity/v3/projects/de525ebdfc9346a69d911aa830b98049/users/e6736929ec2f4da3aecb614d6048794d/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:18.371879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c2eecb4d-124b-47fd-90ad-aa3ad8a8ad46 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:18.374141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c2eecb4d-124b-47fd-90ad-aa3ad8a8ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:18.434035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:18.454756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1066/2131] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:18.457807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:18.470927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0cfdc-cd0e-4c75-93c5-5c2a512d0e9e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:18.479602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:18.482890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.482890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.482890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.482890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:18.483259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:18.485335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:18.508846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eecb4d-124b-47fd-90ad-aa3ad8a8ad46 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:18.524368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1066/2132] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:20:18.526605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eecb4d-124b-47fd-90ad-aa3ad8a8ad46 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:18.537661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:18.538549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.539392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.540605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.541571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:18.544325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:18.725390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1067/2133] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:18 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:18.729720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:18.740597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52a0ab-d85c-46da-86a4-2fe98f109820 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:18.810856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:18.811530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.811848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.812129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.812872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:18.815386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:18.927601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1067/2134] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:18 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:18.929202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:18.941527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a31c7b-cfde-4752-ab24-e2b7b5cd92fe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:18.955729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:18.956469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:18.956754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:18.957033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:18.957875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:18.959894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:18.977738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1068/2135] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:18.981510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:19.006223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52a305-c45e-4fb5-9fa0-d0aecd15f4a7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:19.014963 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d272-aa00-4bab-8a85-a128cb8417a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:19.015640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d272-aa00-4bab-8a85-a128cb8417a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:19.015922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d272-aa00-4bab-8a85-a128cb8417a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:19.016245 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d272-aa00-4bab-8a85-a128cb8417a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:19.017014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801d272-aa00-4bab-8a85-a128cb8417a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:19.023918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801d272-aa00-4bab-8a85-a128cb8417a6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:19.040092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1068/2136] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:19.044221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:19.065068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b499e0-c3b4-4b3f-83b0-bec4eb5645e3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:19.072659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:19.073711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:19.074846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:19.075157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] PATH_INFO: `/v3/projects/c9d077257cbc4acd850a9cba1af0c300/users/6fd1eb50d00a404e8bf513eaa46e12ba/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:19.102028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d077257cbc4acd850a9cba1af0c300, user_id=6fd1eb50d00a404e8bf513eaa46e12ba, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:19.116874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:19.266149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1069/2137] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:19 2022] PUT /identity/v3/projects/c9d077257cbc4acd850a9cba1af0c300/users/6fd1eb50d00a404e8bf513eaa46e12ba/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:19.274239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737486bc-4db4-4cae-a845-cf856f5e5c73 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:19.274546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737486bc-4db4-4cae-a845-cf856f5e5c73 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:19.274970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737486bc-4db4-4cae-a845-cf856f5e5c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:19.308243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-737486bc-4db4-4cae-a845-cf856f5e5c73 None None] MFA Rules not processed for user `6fd1eb50d00a404e8bf513eaa46e12ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:19.316450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-737486bc-4db4-4cae-a845-cf856f5e5c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:19.407858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1069/2138] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:19.412405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:19.507547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4eb53-aace-4392-8794-3f1cc3908c59 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:19.519161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:19.519854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:19.520139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:19.520460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:19.521801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:19.523818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:19.638223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1070/2139] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:19 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:19.642450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737486bc-4db4-4cae-a845-cf856f5e5c73 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:19.659990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737486bc-4db4-4cae-a845-cf856f5e5c73 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:19.765086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:19.774559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:19.775177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:19.775527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:19.776181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:19.776697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:19.778690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:19.886393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1070/2140] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:19 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:19.889751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:19.901361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eb859-d819-49bb-aa08-a9da9ad36635 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:19.906778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:19.908571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:19.908926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:19.909422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:19.910396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:19.913136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:19.927422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1071/2141] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:19.931879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:19.950450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d44ba-be6f-4a40-aae2-fd821ae8f710 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:19.963239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:19.964150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:19.964469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:19.964746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] PATH_INFO: `/v3/projects/60cc4f07a5f042468347f40632c20055/users/d15fa57528134aa88c80042f36e7e06e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:20.004836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cc4f07a5f042468347f40632c20055, user_id=d15fa57528134aa88c80042f36e7e06e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:20.007549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:20.115842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1071/2142] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:19 2022] PUT /identity/v3/projects/60cc4f07a5f042468347f40632c20055/users/d15fa57528134aa88c80042f36e7e06e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:20.119902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:20.133780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c6617-d1f5-490b-ae65-ab276a3cea1b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:20.214540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8a3eb-362f-47d3-9025-4b8c3bd2a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:20.215229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a3eb-362f-47d3-9025-4b8c3bd2a509 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:20.215512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a3eb-362f-47d3-9025-4b8c3bd2a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:20.215791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a3eb-362f-47d3-9025-4b8c3bd2a509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:20.217226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8a3eb-362f-47d3-9025-4b8c3bd2a509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:20.219773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8a3eb-362f-47d3-9025-4b8c3bd2a509 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:20.236439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1072/2143] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:20.238241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:20.253446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493207-56dc-4dce-8056-2e2f024b5933 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:20.264362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:20.266274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:20.267224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:20.267523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] PATH_INFO: `/v3/projects/60cc4f07a5f042468347f40632c20055/users/d15fa57528134aa88c80042f36e7e06e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:20.271157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cc4f07a5f042468347f40632c20055, user_id=d15fa57528134aa88c80042f36e7e06e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:20.275969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:20.304458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1072/2144] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:20 2022] PUT /identity/v3/projects/60cc4f07a5f042468347f40632c20055/users/d15fa57528134aa88c80042f36e7e06e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:20.311208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2b07-ddee-40a1-9623-58447269f4ac None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:20.311511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2b07-ddee-40a1-9623-58447269f4ac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:20.311870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2b07-ddee-40a1-9623-58447269f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:20.366383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-557e2b07-ddee-40a1-9623-58447269f4ac None None] MFA Rules not processed for user `d15fa57528134aa88c80042f36e7e06e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:20.367732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-557e2b07-ddee-40a1-9623-58447269f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:20.537063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1073/2145] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:20.552615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:20.555021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:20.647666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8ccf2-a8a0-402d-8df0-d2095696f556 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:20.665255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239497b1-bf8b-4dfa-834f-87548d648dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:20.666238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239497b1-bf8b-4dfa-834f-87548d648dcc service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:20.666530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239497b1-bf8b-4dfa-834f-87548d648dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:20.666805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239497b1-bf8b-4dfa-834f-87548d648dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:20.700260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239497b1-bf8b-4dfa-834f-87548d648dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:20.700260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239497b1-bf8b-4dfa-834f-87548d648dcc service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:20.723325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1073/2146] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:20.804739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e2b07-ddee-40a1-9623-58447269f4ac None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:20.879869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e2b07-ddee-40a1-9623-58447269f4ac None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:20.884621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:20.885509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:20.885787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:20.886059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] PATH_INFO: `/v3/users/6fd1eb50d00a404e8bf513eaa46e12ba` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:20.887526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd1eb50d00a404e8bf513eaa46e12ba)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:20.889641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:21.163423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd1eb50d00a404e8bf513eaa46e12ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:21.186236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd1eb50d00a404e8bf513eaa46e12ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:21.199101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd1eb50d00a404e8bf513eaa46e12ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:21.199990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd1eb50d00a404e8bf513eaa46e12ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:21.210666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:21.330626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd1eb50d00a404e8bf513eaa46e12ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:21.337536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1074/2147] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:20 2022] DELETE /identity/v3/users/6fd1eb50d00a404e8bf513eaa46e12ba => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:21.342107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:21.345639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:21.345639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:21.361786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:21.363022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:21.454081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1074/2148] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:21.465435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:21.466957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:21.545717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599f478-01d4-488e-bb8f-a8c0fce90927 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:21.552617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:21.553417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:21.553774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:21.557321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:21.573108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:21.574576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:21.586092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1075/2149] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:22.010754 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:22.323507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:22.325209 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:22.343304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586550-85eb-414f-8829-da6c25ddf5bb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:22.348914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:22.349849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:22.350187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:22.350474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] PATH_INFO: `/v3/projects/c9d077257cbc4acd850a9cba1af0c300` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:22.351755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d077257cbc4acd850a9cba1af0c300)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:22.354139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:22.526345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d077257cbc4acd850a9cba1af0c300', 'request_id': 'req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:22.605230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d077257cbc4acd850a9cba1af0c300', 'request_id': 'req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:22.643619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d077257cbc4acd850a9cba1af0c300', 'request_id': 'req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:22.677790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] The token cache is being invalidate because project c9d077257cbc4acd850a9cba1af0c300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:22.678433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:22.679272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:22.682037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1075/2150] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:22 2022] DELETE /identity/v3/projects/c9d077257cbc4acd850a9cba1af0c300 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:22.685975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:22.697271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8acec-afa2-423d-8a75-b6b019d7754f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:22.783747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:22.789695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:22.789695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:22.789695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] PATH_INFO: `/v3/users/d15fa57528134aa88c80042f36e7e06e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:22.789695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15fa57528134aa88c80042f36e7e06e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:22.790246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:23.063578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15fa57528134aa88c80042f36e7e06e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:23.077831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15fa57528134aa88c80042f36e7e06e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:23.087622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15fa57528134aa88c80042f36e7e06e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:23.088561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15fa57528134aa88c80042f36e7e06e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:23.193519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dee8a2ea-bd13-44dc-b559-53fe3f1fb7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15fa57528134aa88c80042f36e7e06e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:23.208953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1076/2151] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:22 2022] DELETE /identity/v3/users/d15fa57528134aa88c80042f36e7e06e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:23.821824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:23.824108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:23.857430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dda2e-f5e2-4f26-9a3c-0a1a70d7d98d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:23.881306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:23.935419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:23.936619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:23.936995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:23.937369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] PATH_INFO: `/v3/projects/60cc4f07a5f042468347f40632c20055` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:23.939041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cc4f07a5f042468347f40632c20055)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:23.942712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:24.165463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cc4f07a5f042468347f40632c20055', 'request_id': 'req-e8be9c37-ea29-4698-8b1e-f19c5902a364'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:24.399049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cc4f07a5f042468347f40632c20055', 'request_id': 'req-e8be9c37-ea29-4698-8b1e-f19c5902a364'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:24.408516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cc4f07a5f042468347f40632c20055', 'request_id': 'req-e8be9c37-ea29-4698-8b1e-f19c5902a364'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:24.421525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] The token cache is being invalidate because project 60cc4f07a5f042468347f40632c20055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:24.421835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:24.422521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8be9c37-ea29-4698-8b1e-f19c5902a364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:24.424697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1076/2152] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:23 2022] DELETE /identity/v3/projects/60cc4f07a5f042468347f40632c20055 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:24.430882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529c404-5118-4bc8-876a-ef346136e8eb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:24.431246 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529c404-5118-4bc8-876a-ef346136e8eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:24.431695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529c404-5118-4bc8-876a-ef346136e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:24.459948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0529c404-5118-4bc8-876a-ef346136e8eb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:24.462217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0529c404-5118-4bc8-876a-ef346136e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:24.540931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1077/2153] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:24.548813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb92ed-b065-41f8-a29d-7a306134aa77 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:24.549124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb92ed-b065-41f8-a29d-7a306134aa77 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:24.549381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb92ed-b065-41f8-a29d-7a306134aa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:24.570657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bffb92ed-b065-41f8-a29d-7a306134aa77 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:24.572206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bffb92ed-b065-41f8-a29d-7a306134aa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:24.607998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1077/2154] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:24.611577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529c404-5118-4bc8-876a-ef346136e8eb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:24.632901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529c404-5118-4bc8-876a-ef346136e8eb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:24.640884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:24.642274 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:24.642545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:24.643011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:24.649026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:24.649489 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:24.652091 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:24.667804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:24.672321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1078/2155] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:20:24.677298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb92ed-b065-41f8-a29d-7a306134aa77 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:24.692232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb92ed-b065-41f8-a29d-7a306134aa77 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:24.699611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:24.700419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:24.701371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:24.701663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:24.702558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:24.706268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:24.804221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1078/2156] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:24 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:24.805439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:24.817550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e58f-43b2-4623-83bb-3e838ca7c37b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:24.902436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:24.903358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:24.903883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:24.904310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:24.905476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:24.908792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:25.075645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1079/2157] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:24 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:25.080652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:25.091979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24182d98-99fd-48db-b00b-b5a76ff26cd1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:25.098150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:25.099448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:25.100135 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:25.101533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:25.103218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:25.107070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:25.121144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1079/2158] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:25.125253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:25.137839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5851-18ad-4c1e-88bc-cb798c98cfee admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:25.143060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4310-5eb8-496c-9995-b27496c179ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:25.144330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4310-5eb8-496c-9995-b27496c179ac admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:25.144822 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4310-5eb8-496c-9995-b27496c179ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:25.145214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4310-5eb8-496c-9995-b27496c179ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:25.145836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4310-5eb8-496c-9995-b27496c179ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:25.148083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4310-5eb8-496c-9995-b27496c179ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:25.167919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:25.169343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1080/2159] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:25.190969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21bb4-9fda-4061-8284-0fbcdbd1ca59 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:25.196768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:25.197673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:25.198109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:25.200219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] PATH_INFO: `/v3/projects/f1b978ba335d4a3e8aeb0149f1336f61/users/22383bfefc48434dba2b39aeb46cfc8f/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:25.236498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b978ba335d4a3e8aeb0149f1336f61, user_id=22383bfefc48434dba2b39aeb46cfc8f, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:25.240439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:25.383063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1080/2160] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:25 2022] PUT /identity/v3/projects/f1b978ba335d4a3e8aeb0149f1336f61/users/22383bfefc48434dba2b39aeb46cfc8f/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:25.387790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9e82-8aef-4c86-8d00-c7655d5902cc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:25.388090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9e82-8aef-4c86-8d00-c7655d5902cc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:25.389701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9e82-8aef-4c86-8d00-c7655d5902cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:25.429779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-badb9e82-8aef-4c86-8d00-c7655d5902cc None None] MFA Rules not processed for user `22383bfefc48434dba2b39aeb46cfc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:25.431236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-badb9e82-8aef-4c86-8d00-c7655d5902cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:25.567644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1081/2161] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:25.588263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:25.591312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:25.733192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a478-366c-42e5-ae54-216a127dd5cb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:25.744385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1d78-12fd-4d99-b34f-46924260c081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:25.745179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1d78-12fd-4d99-b34f-46924260c081 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:25.745536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1d78-12fd-4d99-b34f-46924260c081 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:25.746297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1d78-12fd-4d99-b34f-46924260c081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:25.765774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec1d78-12fd-4d99-b34f-46924260c081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:25.767348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec1d78-12fd-4d99-b34f-46924260c081 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:25.787464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1081/2162] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:25.815546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb9e82-8aef-4c86-8d00-c7655d5902cc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:25.851276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:25.851557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:25.851836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:25.900440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] MFA Rules not processed for user `e6736929ec2f4da3aecb614d6048794d`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:25.901876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:25.948889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb9e82-8aef-4c86-8d00-c7655d5902cc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:25.956371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:25.957580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:25.958051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:25.958478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] PATH_INFO: `/v3/users/22383bfefc48434dba2b39aeb46cfc8f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:25.960037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22383bfefc48434dba2b39aeb46cfc8f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:25.962309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:26.033260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1082/2163] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:26.049577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:26.051145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:26.229453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b04d9-4048-4971-b706-56cff35e7d04 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:26.233437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22383bfefc48434dba2b39aeb46cfc8f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:26.255418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40115-8931-42de-9824-4f7bdf3ceb29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:26.256704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40115-8931-42de-9824-4f7bdf3ceb29 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:26.258000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40115-8931-42de-9824-4f7bdf3ceb29 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:26.258372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40115-8931-42de-9824-4f7bdf3ceb29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:26.260872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0ba40115-8931-42de-9824-4f7bdf3ceb29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:26.270426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22383bfefc48434dba2b39aeb46cfc8f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:26.286175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22383bfefc48434dba2b39aeb46cfc8f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:26.286175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22383bfefc48434dba2b39aeb46cfc8f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:26.350617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40115-8931-42de-9824-4f7bdf3ceb29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:26.352418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40115-8931-42de-9824-4f7bdf3ceb29 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:26.363329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1083/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:26.409269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22383bfefc48434dba2b39aeb46cfc8f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:26.416766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1082/2165] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:25 2022] DELETE /identity/v3/users/22383bfefc48434dba2b39aeb46cfc8f => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:26.421370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3109049-d540-4682-9266-3917901b41c9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:26.421646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3109049-d540-4682-9266-3917901b41c9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:26.421952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3109049-d540-4682-9266-3917901b41c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:26.445729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c3109049-d540-4682-9266-3917901b41c9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:26.445729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c3109049-d540-4682-9266-3917901b41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:26.514664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1084/2166] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:26.525003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:26.526455 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:26.589347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85fa3f-61c3-4529-9465-a5756471da28 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:26.592973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e7464-44c4-47b4-a87a-5c46b120364e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:26.593608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7464-44c4-47b4-a87a-5c46b120364e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:26.593889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7464-44c4-47b4-a87a-5c46b120364e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:26.594162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7464-44c4-47b4-a87a-5c46b120364e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:26.603092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e7464-44c4-47b4-a87a-5c46b120364e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:26.604565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e7464-44c4-47b4-a87a-5c46b120364e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:26.616646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1083/2167] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:27.377201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3109049-d540-4682-9266-3917901b41c9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:27.378717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c3109049-d540-4682-9266-3917901b41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:27.404532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3109049-d540-4682-9266-3917901b41c9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:27.411780 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:27.412702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:27.413218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:27.413912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] PATH_INFO: `/v3/projects/f1b978ba335d4a3e8aeb0149f1336f61` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:27.416793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b978ba335d4a3e8aeb0149f1336f61)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:27.418690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:27.541658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b978ba335d4a3e8aeb0149f1336f61', 'request_id': 'req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:27.549975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:27.658157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b978ba335d4a3e8aeb0149f1336f61', 'request_id': 'req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:27.674720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b978ba335d4a3e8aeb0149f1336f61', 'request_id': 'req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:27.690618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] The token cache is being invalidate because project f1b978ba335d4a3e8aeb0149f1336f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:27.691421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:27.692372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:27.694548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1085/2168] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:27 2022] DELETE /identity/v3/projects/f1b978ba335d4a3e8aeb0149f1336f61 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:28.519538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:31.885145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:32.341712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:34.426972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9644e26-2caf-4a8c-945f-1f2602c748ba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:34.427415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9644e26-2caf-4a8c-945f-1f2602c748ba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:34.427415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9644e26-2caf-4a8c-945f-1f2602c748ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:34.457765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d9644e26-2caf-4a8c-945f-1f2602c748ba None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:34.459102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d9644e26-2caf-4a8c-945f-1f2602c748ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:34.500396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:34.538737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1084/2169] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:20:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:34.595163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:34.596599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:34.709237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f922-d173-4cfb-a8a4-d1acc3e05f76 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:34.714690 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:34.715337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:34.715617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:34.715890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:34.724492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:34.726147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:34.734509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1086/2170] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:20:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:20:35.767576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601771a-fd57-41f0-ab75-259c00628161 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:35.768012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601771a-fd57-41f0-ab75-259c00628161 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:35.768130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601771a-fd57-41f0-ab75-259c00628161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:35.789929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d601771a-fd57-41f0-ab75-259c00628161 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:35.792311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d601771a-fd57-41f0-ab75-259c00628161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:35.802247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1085/2171] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 08:20:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:35.817502 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:35.828897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944b49b-ebbf-4ec0-939d-e9ea2f81cb0c service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:35.835499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:35.836492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:35.837382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:35.837808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:35.847469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:35.849082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:35.858175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1087/2172] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:20:36.547374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41a0b-7fbc-4f47-a818-7949b632606a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:36.547659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41a0b-7fbc-4f47-a818-7949b632606a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:36.547973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41a0b-7fbc-4f47-a818-7949b632606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:36.566273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cfc41a0b-7fbc-4f47-a818-7949b632606a None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:36.567405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cfc41a0b-7fbc-4f47-a818-7949b632606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:36.575096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1086/2173] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:20:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:36.589693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:36.599460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1d436-871a-424c-86bb-16ba8de3ae35 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:36.604588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:36.605221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:36.605509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:36.605788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:36.618255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:36.618255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:36.626914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1088/2174] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:20:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:20:37.484548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:37.484986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:37.485255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:37.506105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:37.507450 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:37.515371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1087/2175] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 08:20:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:37.528452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:37.539770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469d77f-e763-4099-9895-067d39f289b0 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:37.545652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c6771-e77f-4a42-b500-53677b500614 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:37.545652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6771-e77f-4a42-b500-53677b500614 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:37.545903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6771-e77f-4a42-b500-53677b500614 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:37.546141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6771-e77f-4a42-b500-53677b500614 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:37.555160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c6771-e77f-4a42-b500-53677b500614 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:37.556765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c6771-e77f-4a42-b500-53677b500614 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:37.572224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1089/2176] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:20:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:20:39.781452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:39.785293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:39.888933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce79e4-869d-4d37-97a9-3efaa139ccc2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:39.894804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:39.895699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:39.896011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:39.896359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] PATH_INFO: `/v3/users/78f425e314fc44e483cb392facf236da` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:39.902367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f425e314fc44e483cb392facf236da)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:39.902367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:39.935517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf52e-cb21-4cbb-acd6-ab093967953e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:39.936074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf52e-cb21-4cbb-acd6-ab093967953e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:39.936074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf52e-cb21-4cbb-acd6-ab093967953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:39.950507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:39.959000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-866bf52e-cb21-4cbb-acd6-ab093967953e None None] MFA Rules not processed for user `633cfb032a0344619f95e72492e85b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:39.960355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-866bf52e-cb21-4cbb-acd6-ab093967953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:40.034200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1090/2177] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:40.131462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f425e314fc44e483cb392facf236da'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.145653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f425e314fc44e483cb392facf236da'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.154423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f425e314fc44e483cb392facf236da'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.155261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f425e314fc44e483cb392facf236da'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.159224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:40.256327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f425e314fc44e483cb392facf236da'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.262995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1088/2178] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:39 2022] DELETE /identity/v3/users/78f425e314fc44e483cb392facf236da => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:40.268175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:40.268507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:40.268803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:40.296828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:40.298069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:40.373177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1091/2179] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:40.383969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:40.385662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:40.473150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05870ebd-08b8-4411-979b-490b0771eaeb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:40.478463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:40.478463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:40.478463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:40.478463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:40.488030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:40.489510 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:40.499513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1089/2180] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:40.670545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:40.671960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:40.684702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96bba4-01ba-45d9-b127-fb073263638b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:40.693384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:40.694322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:40.694609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:40.694881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] PATH_INFO: `/v3/users/c699081f0e2249e2b9e36f6398aa4a88` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:40.696388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c699081f0e2249e2b9e36f6398aa4a88)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:40.698290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:40.902166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c699081f0e2249e2b9e36f6398aa4a88'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.910154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c699081f0e2249e2b9e36f6398aa4a88'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.910830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c699081f0e2249e2b9e36f6398aa4a88'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.911453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c699081f0e2249e2b9e36f6398aa4a88'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.923794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c95636ee-b77a-4c32-801e-80b18b5280bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c699081f0e2249e2b9e36f6398aa4a88'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:40.997571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:40.999195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:41.013708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1092/2181] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:40 2022] DELETE /identity/v3/users/c699081f0e2249e2b9e36f6398aa4a88 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:41.018186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.018753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.021354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.026538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ea155-a8c7-4e18-8f69-3e9a32dc7ab0 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:41.043603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:41.050909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:41.081582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:41.144942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:41.148735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.148735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.148735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] PATH_INFO: `/v3/projects/acaa2b3893014c3492ff2caed186de83` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.151741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] RBAC: Authorizing `identity:delete_project(project_id=acaa2b3893014c3492ff2caed186de83)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:41.161262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:41.164094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1093/2182] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:41.184490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:41.185926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:41.276039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a927b6-0229-431e-9b73-ffe08665d476 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:41.280136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c755-0a5c-49ac-bc46-952f2448cb85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:41.281136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c755-0a5c-49ac-bc46-952f2448cb85 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.281419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c755-0a5c-49ac-bc46-952f2448cb85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.281698 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c755-0a5c-49ac-bc46-952f2448cb85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.303796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c755-0a5c-49ac-bc46-952f2448cb85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:41.306332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c755-0a5c-49ac-bc46-952f2448cb85 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:41.319709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1094/2183] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:20:41.332895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acaa2b3893014c3492ff2caed186de83', 'request_id': 'req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:41.339909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acaa2b3893014c3492ff2caed186de83', 'request_id': 'req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:41.457080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acaa2b3893014c3492ff2caed186de83', 'request_id': 'req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:41.472693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] The token cache is being invalidate because project acaa2b3893014c3492ff2caed186de83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:41.473194 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:41.474266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f4c35c6b-fb23-4eb5-9d86-f7f2feedeaae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:41.485179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dcebd-26af-40a7-b02c-d0e74392a0e7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.486281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dcebd-26af-40a7-b02c-d0e74392a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.486989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dcebd-26af-40a7-b02c-d0e74392a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.502584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1090/2184] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:40 2022] DELETE /identity/v3/projects/acaa2b3893014c3492ff2caed186de83 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:41.546663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-923dcebd-26af-40a7-b02c-d0e74392a0e7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:41.548495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-923dcebd-26af-40a7-b02c-d0e74392a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:41.624907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1095/2185] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:41.633272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbf1c-e828-4981-a171-95245c47d57d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.633543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbf1c-e828-4981-a171-95245c47d57d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.633841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbf1c-e828-4981-a171-95245c47d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.646415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:41.652632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f19cbf1c-e828-4981-a171-95245c47d57d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:41.653832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f19cbf1c-e828-4981-a171-95245c47d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:41.662531 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1091/2186] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:41.667012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dcebd-26af-40a7-b02c-d0e74392a0e7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:41.678560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dcebd-26af-40a7-b02c-d0e74392a0e7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:41.683314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:41.683979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.684553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.684838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.685621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:41.685954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:41.687547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:41.700425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1096/2187] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:20:41.704993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbf1c-e828-4981-a171-95245c47d57d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:41.714845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbf1c-e828-4981-a171-95245c47d57d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:41.719643 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:41.720360 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.720646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.720924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.721620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:41.723623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:41.757524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:41.759439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:41.775775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1427f4-7066-4511-b4f8-3d24203dfffc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:41.781628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:41.782539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:41.782946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:41.783559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] PATH_INFO: `/v3/projects/432ff4dfb4b240c097681d905c2dcc8f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:41.785485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432ff4dfb4b240c097681d905c2dcc8f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:41.787946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:41.873691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1092/2188] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:41 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:41.874647 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:41.920655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:41.938204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432ff4dfb4b240c097681d905c2dcc8f', 'request_id': 'req-34813bee-15b7-4a1f-bb35-0d469f7b50e5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:41.943190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ed5c8-f2bc-4a69-9bd5-699a87dec611 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:42.002570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:42.003225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:42.003429 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:42.003708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:42.004453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:42.006389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:42.056385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432ff4dfb4b240c097681d905c2dcc8f', 'request_id': 'req-34813bee-15b7-4a1f-bb35-0d469f7b50e5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:42.065883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432ff4dfb4b240c097681d905c2dcc8f', 'request_id': 'req-34813bee-15b7-4a1f-bb35-0d469f7b50e5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:42.076669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] The token cache is being invalidate because project 432ff4dfb4b240c097681d905c2dcc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:42.076957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:42.077659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:42.081704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1097/2189] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:41 2022] DELETE /identity/v3/projects/432ff4dfb4b240c097681d905c2dcc8f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:20:42.129699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1093/2190] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:41 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:20:42.134174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:42.135740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:42.150488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34813bee-15b7-4a1f-bb35-0d469f7b50e5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:42.158895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:42.159692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:42.159982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:42.160293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:42.161646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:42.163482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:42.176891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1098/2191] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:42.181178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:42.198137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017270d-2c99-4081-8f38-6dc328c96706 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:42.203640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e61e7-346f-4e0e-9ceb-993ba43cb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:42.205168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e61e7-346f-4e0e-9ceb-993ba43cb016 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:42.205168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e61e7-346f-4e0e-9ceb-993ba43cb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:42.205168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e61e7-346f-4e0e-9ceb-993ba43cb016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:42.205893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e61e7-346f-4e0e-9ceb-993ba43cb016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:42.207594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e61e7-346f-4e0e-9ceb-993ba43cb016 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:42.226454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1094/2192] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:42.231430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:42.252523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c1b7-34b0-4e0d-8020-de3124f9e4b9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:42.269439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:42.270346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:42.270629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:42.270997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] PATH_INFO: `/v3/projects/37bc173c84a9482d9d062f90ce4fbd7e/users/a39eac005bac4296871ee9664e35f2a8/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:42.289801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37bc173c84a9482d9d062f90ce4fbd7e, user_id=a39eac005bac4296871ee9664e35f2a8, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:42.292659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:42.408286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1099/2193] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:42 2022] PUT /identity/v3/projects/37bc173c84a9482d9d062f90ce4fbd7e/users/a39eac005bac4296871ee9664e35f2a8/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:42.419097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4433fc7-e421-4a1c-9c2d-2f03c7bee37f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:42.419390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4433fc7-e421-4a1c-9c2d-2f03c7bee37f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:42.419674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4433fc7-e421-4a1c-9c2d-2f03c7bee37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:42.447446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b4433fc7-e421-4a1c-9c2d-2f03c7bee37f None None] MFA Rules not processed for user `a39eac005bac4296871ee9664e35f2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:42.448799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b4433fc7-e421-4a1c-9c2d-2f03c7bee37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:42.506562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:42.520214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1095/2194] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:42.531422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:42.533156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:42.606747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e273c-c335-456f-b102-258fcb9d1845 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:42.611286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8132127-f5ed-4465-9f15-e59ceabdac92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:42.612325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8132127-f5ed-4465-9f15-e59ceabdac92 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:42.612610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8132127-f5ed-4465-9f15-e59ceabdac92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:42.612888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8132127-f5ed-4465-9f15-e59ceabdac92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:42.627517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8132127-f5ed-4465-9f15-e59ceabdac92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:42.629422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8132127-f5ed-4465-9f15-e59ceabdac92 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:42.639053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1100/2195] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:42.664674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4433fc7-e421-4a1c-9c2d-2f03c7bee37f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:42.732216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4433fc7-e421-4a1c-9c2d-2f03c7bee37f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:42.737493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:42.738438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:42.738860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:42.739137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] PATH_INFO: `/v3/users/a39eac005bac4296871ee9664e35f2a8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:42.740498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39eac005bac4296871ee9664e35f2a8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:42.743474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:43.110998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39eac005bac4296871ee9664e35f2a8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:43.122710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39eac005bac4296871ee9664e35f2a8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:43.129919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39eac005bac4296871ee9664e35f2a8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:43.130591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39eac005bac4296871ee9664e35f2a8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:43.260604 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39eac005bac4296871ee9664e35f2a8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:43.267934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1096/2196] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:20:42 2022] DELETE /identity/v3/users/a39eac005bac4296871ee9664e35f2a8 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:43.274100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:43.274100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:43.274100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:43.298204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:43.300033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:43.384280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1101/2197] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:20:43.394427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:43.395984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:43.455259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e19d2-fba1-4cf9-a238-7b1d441e193c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:43.458896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f07f-0483-48a2-8a71-0b5db0a02684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:43.459597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f07f-0483-48a2-8a71-0b5db0a02684 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:43.459832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f07f-0483-48a2-8a71-0b5db0a02684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:43.460100 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f07f-0483-48a2-8a71-0b5db0a02684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:43.469690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f07f-0483-48a2-8a71-0b5db0a02684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:43.471164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f07f-0483-48a2-8a71-0b5db0a02684 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:43.480767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1097/2198] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:44.038237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:44.040366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:44.055797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f725-f050-4879-8f02-cc7714abe805 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:44.061052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:44.061914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.062193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.062569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] PATH_INFO: `/v3/projects/37bc173c84a9482d9d062f90ce4fbd7e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.063663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37bc173c84a9482d9d062f90ce4fbd7e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:44.065652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:44.089238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:44.188354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37bc173c84a9482d9d062f90ce4fbd7e', 'request_id': 'req-bd2664b4-cd57-4c43-a026-76df366ff633'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:44.289993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37bc173c84a9482d9d062f90ce4fbd7e', 'request_id': 'req-bd2664b4-cd57-4c43-a026-76df366ff633'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:44.297628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37bc173c84a9482d9d062f90ce4fbd7e', 'request_id': 'req-bd2664b4-cd57-4c43-a026-76df366ff633'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:44.310651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] The token cache is being invalidate because project 37bc173c84a9482d9d062f90ce4fbd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:20:44.310940 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:44.311660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bd2664b4-cd57-4c43-a026-76df366ff633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:20:44.314138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1102/2199] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:20:44 2022] DELETE /identity/v3/projects/37bc173c84a9482d9d062f90ce4fbd7e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:44.319157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d87ed-a83e-40ed-9e46-281eb0e746dd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.319656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d87ed-a83e-40ed-9e46-281eb0e746dd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.319763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d87ed-a83e-40ed-9e46-281eb0e746dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.345065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:44.351306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-296d87ed-a83e-40ed-9e46-281eb0e746dd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:44.353054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-296d87ed-a83e-40ed-9e46-281eb0e746dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:44.426944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1098/2200] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:44.436069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df9a0-d13c-4724-a847-9f6cf44c5ad0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.436530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df9a0-d13c-4724-a847-9f6cf44c5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.437049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df9a0-d13c-4724-a847-9f6cf44c5ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.458915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a07df9a0-d13c-4724-a847-9f6cf44c5ad0 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:44.460313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a07df9a0-d13c-4724-a847-9f6cf44c5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:44.468488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1103/2201] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:44.476488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d87ed-a83e-40ed-9e46-281eb0e746dd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:44.487143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d87ed-a83e-40ed-9e46-281eb0e746dd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:44.491936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:44.492643 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.492991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.493224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.494108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:20:44.494299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:44.495931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:44.508149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1099/2202] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:20:44.512530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df9a0-d13c-4724-a847-9f6cf44c5ad0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:44.522862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df9a0-d13c-4724-a847-9f6cf44c5ad0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:44.527653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:44.528337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.528619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.528890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.529575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:44.531457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:44.618298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1104/2203] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:20:44 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:44.622607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:44.633725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aee687-4f06-4409-841d-9b0b8fe05e43 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:44.693012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:44.693560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.693842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.694125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.694832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:44.696779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:44.806337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1100/2204] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:20:44 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:20:44.810248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:44.821781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193f1e2-0916-47e8-a879-78a70bb97fd4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:44.826818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:44.827592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.827879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.828315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.829077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:44.831298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:44.843957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1105/2205] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:20:44.848076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:44.858421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1634-3acc-449a-a183-7cf39fb7d546 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:44.863819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497ac3-cd0e-45da-935c-5b2aa91d3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:44.864503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497ac3-cd0e-45da-935c-5b2aa91d3e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.866017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497ac3-cd0e-45da-935c-5b2aa91d3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.866017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497ac3-cd0e-45da-935c-5b2aa91d3e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.866017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497ac3-cd0e-45da-935c-5b2aa91d3e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:44.867546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497ac3-cd0e-45da-935c-5b2aa91d3e38 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:44.878685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1101/2206] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:20:44.882800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:44.894190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8803ab-7409-4448-8b95-baab8f1f9fa1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:44.898965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:44.899839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:44.900122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:44.900479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] PATH_INFO: `/v3/projects/dae6efd4ad46479cb965caa8a97a772a/users/69533891e4cf463bb3fe9ac5cf7f4215/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:44.918196 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae6efd4ad46479cb965caa8a97a772a, user_id=69533891e4cf463bb3fe9ac5cf7f4215, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:44.921026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:45.018164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1106/2207] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:20:44 2022] PUT /identity/v3/projects/dae6efd4ad46479cb965caa8a97a772a/users/69533891e4cf463bb3fe9ac5cf7f4215/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:20:45.025893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b5228-489c-4bb6-8ea6-39410422cfac None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:45.026363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b5228-489c-4bb6-8ea6-39410422cfac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:45.026720 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b5228-489c-4bb6-8ea6-39410422cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:45.051364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8a1b5228-489c-4bb6-8ea6-39410422cfac None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:45.052691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a1b5228-489c-4bb6-8ea6-39410422cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:45.119998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1102/2208] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:45.130023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:45.131820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:45.200292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dda65-fe69-41ae-bf46-db83cb2766bd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:45.205189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:45.205845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:45.206133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:45.206411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:45.216453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:45.218400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:45.231089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1107/2209] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:46.529566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2fc7c-0a1b-48a8-8e7c-fa2b5002f94a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:46.530706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2fc7c-0a1b-48a8-8e7c-fa2b5002f94a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:46.531485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2fc7c-0a1b-48a8-8e7c-fa2b5002f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:46.571753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:46.581292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9be2fc7c-0a1b-48a8-8e7c-fa2b5002f94a None None] MFA Rules not processed for user `69533891e4cf463bb3fe9ac5cf7f4215`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:46.582722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9be2fc7c-0a1b-48a8-8e7c-fa2b5002f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:46.725326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1103/2210] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:46.743878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:46.745518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:46.808513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:46.816716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f61f2-b22f-49fe-b025-96f171dc29d5 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:46.820862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f6a7-5ff2-425a-85dd-b043cf9919f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:46.821694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f6a7-5ff2-425a-85dd-b043cf9919f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:46.822110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f6a7-5ff2-425a-85dd-b043cf9919f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:46.822622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f6a7-5ff2-425a-85dd-b043cf9919f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:46.832176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f6a7-5ff2-425a-85dd-b043cf9919f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:46.834406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f6a7-5ff2-425a-85dd-b043cf9919f4 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:46.846478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1108/2211] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:20:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:20:48.321310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3096ef4-0729-438a-b014-1d04c29bffac None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:48.322811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3096ef4-0729-438a-b014-1d04c29bffac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:48.322811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3096ef4-0729-438a-b014-1d04c29bffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:48.340028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d3096ef4-0729-438a-b014-1d04c29bffac None None] MFA Rules not processed for user `5ebbd67cca66411ea52e4b92478564cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:48.341278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3096ef4-0729-438a-b014-1d04c29bffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:48.398443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1104/2212] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:49.705663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ad9b-8077-430f-847e-4d4f80f5f6cb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:49.706195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ad9b-8077-430f-847e-4d4f80f5f6cb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:49.706195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ad9b-8077-430f-847e-4d4f80f5f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:49.723555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9c58ad9b-8077-430f-847e-4d4f80f5f6cb None None] MFA Rules not processed for user `69533891e4cf463bb3fe9ac5cf7f4215`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:49.724781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9c58ad9b-8077-430f-847e-4d4f80f5f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:49.731570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1109/2213] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:50.815979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:50.815979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:50.815979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:50.833102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] MFA Rules not processed for user `01fe8c57517d4ca5958ec13139aa2b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:50.834552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:50.903875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1105/2214] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:20:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:52.483390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8056-1e2b-40de-b89e-e131af78b638 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:52.483902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8056-1e2b-40de-b89e-e131af78b638 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:52.484578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8056-1e2b-40de-b89e-e131af78b638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:52.541910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-280b8056-1e2b-40de-b89e-e131af78b638 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:20:52.543304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-280b8056-1e2b-40de-b89e-e131af78b638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:52.641466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1110/2215] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:20:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:20:52.662990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:20:52.664705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:20:52.762484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:20:52.785874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66f02-f8fe-4094-a6f7-01b8491aee42 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:20:52.792042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238ef3-986f-44c5-bddc-1fb593a5d06d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:20:52.793068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238ef3-986f-44c5-bddc-1fb593a5d06d service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:20:52.798619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238ef3-986f-44c5-bddc-1fb593a5d06d service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:20:52.798619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238ef3-986f-44c5-bddc-1fb593a5d06d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:20:52.803452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38238ef3-986f-44c5-bddc-1fb593a5d06d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:20:52.805088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38238ef3-986f-44c5-bddc-1fb593a5d06d service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:20:52.813930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1106/2216] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:20:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:21:02.631384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=40 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:03.011351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:18.194522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9730f1-b73d-41a8-8483-d5f62e9c8c67 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.195037 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9730f1-b73d-41a8-8483-d5f62e9c8c67 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.195226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9730f1-b73d-41a8-8483-d5f62e9c8c67 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:18.197182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1111/2217] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:21:18.203996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771b51-51a3-4d90-80cf-f12c58c78c20 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.205540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771b51-51a3-4d90-80cf-f12c58c78c20 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.205540 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771b51-51a3-4d90-80cf-f12c58c78c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:18.275719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-68771b51-51a3-4d90-80cf-f12c58c78c20 None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:21:18.277638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-68771b51-51a3-4d90-80cf-f12c58c78c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:18.378787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1107/2218] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:21:18.393150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9730f1-b73d-41a8-8483-d5f62e9c8c67 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:21:18.395627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fa9730f1-b73d-41a8-8483-d5f62e9c8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:18.486954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9730f1-b73d-41a8-8483-d5f62e9c8c67 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:21:18.493421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea1957-2ac7-4d36-8bac-3088b7610f0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:21:18.494364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1957-2ac7-4d36-8bac-3088b7610f0a service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.494629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1957-2ac7-4d36-8bac-3088b7610f0a service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.495034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1957-2ac7-4d36-8bac-3088b7610f0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:18.507914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea1957-2ac7-4d36-8bac-3088b7610f0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:21:18.509583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea1957-2ac7-4d36-8bac-3088b7610f0a service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:21:18.522205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1112/2219] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:21:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:21:18.782349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f3b4-89d4-4e71-b038-bfcfd6301dfa None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.782732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f3b4-89d4-4e71-b038-bfcfd6301dfa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.783104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f3b4-89d4-4e71-b038-bfcfd6301dfa None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:18.784592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1108/2220] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:21:18.789566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454ae5f-3985-4069-9a69-23e9d88ca857 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.789874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454ae5f-3985-4069-9a69-23e9d88ca857 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.791106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454ae5f-3985-4069-9a69-23e9d88ca857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:18.811820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3454ae5f-3985-4069-9a69-23e9d88ca857 None None] MFA Rules not processed for user `2d8183015eed4fd19e4a5fdf57d341e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:21:18.813938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3454ae5f-3985-4069-9a69-23e9d88ca857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:18.820598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1113/2221] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:21:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:21:18.832469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f3b4-89d4-4e71-b038-bfcfd6301dfa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:21:18.845713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f3b4-89d4-4e71-b038-bfcfd6301dfa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:21:18.849598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792dbc6-38d5-429f-aeee-0a82ddde0ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:21:18.850247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792dbc6-38d5-429f-aeee-0a82ddde0ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.850529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792dbc6-38d5-429f-aeee-0a82ddde0ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.850807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792dbc6-38d5-429f-aeee-0a82ddde0ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:18.858835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792dbc6-38d5-429f-aeee-0a82ddde0ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:21:18.861130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792dbc6-38d5-429f-aeee-0a82ddde0ee2 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:21:18.869390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1109/2222] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:21:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:21:18.985878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2d62-9092-4f2d-a3dd-de0a98a9ca9f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.986165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2d62-9092-4f2d-a3dd-de0a98a9ca9f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.986449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2d62-9092-4f2d-a3dd-de0a98a9ca9f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:18.987842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1114/2223] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:21:18.993715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:18.994171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:18.994457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:19.013996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:21:19.016095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:19.026767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1110/2224] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:21:19.038153 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c2d62-9092-4f2d-a3dd-de0a98a9ca9f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:21:19.039886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-798c2d62-9092-4f2d-a3dd-de0a98a9ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:19.053821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c2d62-9092-4f2d-a3dd-de0a98a9ca9f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:21:19.057717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:21:19.058371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:19.058711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:19.059245 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:19.070140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:21:19.071564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:21:19.083839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1115/2225] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:21:23.893827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:21:23.895234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:23.990123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8292d2c-bd00-4247-b35e-9380cd080daa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:21:23.995373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed637882-2e20-444e-b7c0-c415c300b36d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:21:23.996087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637882-2e20-444e-b7c0-c415c300b36d service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:23.996406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637882-2e20-444e-b7c0-c415c300b36d service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:23.996684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637882-2e20-444e-b7c0-c415c300b36d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:23.998503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ed637882-2e20-444e-b7c0-c415c300b36d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:24.010712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed637882-2e20-444e-b7c0-c415c300b36d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:21:24.013860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed637882-2e20-444e-b7c0-c415c300b36d service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:21:24.028649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1111/2226] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:21:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:21:24.604976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:21:24.613949 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c4d0-abd3-4888-839f-37eda4a7e09e service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:21:24.617824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:21:24.618589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:24.618959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:24.619327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:24.621392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:24.690221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:21:24.691647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:21:24.704752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1116/2227] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:21:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:21:26.246368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aca2e-e66d-48a6-a5a8-0c6e345088d7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:26.249890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aca2e-e66d-48a6-a5a8-0c6e345088d7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:26.249890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aca2e-e66d-48a6-a5a8-0c6e345088d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:26.267347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:26.299851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-165aca2e-e66d-48a6-a5a8-0c6e345088d7 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:21:26.301108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-165aca2e-e66d-48a6-a5a8-0c6e345088d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:21:26.318934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1112/2228] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:21:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:21:26.332529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:21:26.354933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7bcf-25e0-4657-b80a-bd2c221ed9f9 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:21:26.360758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:21:26.364156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:21:26.364156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:21:26.364156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:21:26.370440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:21:26.372057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:21:26.381059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1117/2229] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:21:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:21:36.356967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=14 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:21:36.377741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:01.541664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c014-eb94-4405-9778-d1409fd48b8a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:22:01.542339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c014-eb94-4405-9778-d1409fd48b8a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:22:01.542339 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c014-eb94-4405-9778-d1409fd48b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:22:01.562368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8f65c014-eb94-4405-9778-d1409fd48b8a None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:22:01.563577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8f65c014-eb94-4405-9778-d1409fd48b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:22:01.570887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1113/2230] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 08:22:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:22:01.597147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:22:01.609978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c978-57f5-4bdb-a93a-555457628781 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:22:01.615218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b74d-85cf-4b6c-b30d-39f8044a9750 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:22:01.615891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b74d-85cf-4b6c-b30d-39f8044a9750 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:22:01.616176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b74d-85cf-4b6c-b30d-39f8044a9750 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:22:01.616487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b74d-85cf-4b6c-b30d-39f8044a9750 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:22:01.625554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315b74d-85cf-4b6c-b30d-39f8044a9750 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:22:01.631791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315b74d-85cf-4b6c-b30d-39f8044a9750 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:22:01.637088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1118/2231] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:22:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:22:11.555445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:11.632149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:23.034528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7dbb5-73dd-42d6-a716-862492b1b33c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:22:23.035076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7dbb5-73dd-42d6-a716-862492b1b33c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:22:23.035321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7dbb5-73dd-42d6-a716-862492b1b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:22:23.054051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0ee7dbb5-73dd-42d6-a716-862492b1b33c None None] MFA Rules not processed for user `69533891e4cf463bb3fe9ac5cf7f4215`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:22:23.055147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ee7dbb5-73dd-42d6-a716-862492b1b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:22:23.063329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1114/2232] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:22:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:22:24.041749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75247a-5150-4374-a63c-4bfb51b41e95 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:22:24.042246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75247a-5150-4374-a63c-4bfb51b41e95 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:22:24.042353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75247a-5150-4374-a63c-4bfb51b41e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:22:24.061033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6b75247a-5150-4374-a63c-4bfb51b41e95 None None] MFA Rules not processed for user `633cfb032a0344619f95e72492e85b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:22:24.062316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b75247a-5150-4374-a63c-4bfb51b41e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:22:24.118452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1119/2233] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:22:33.047572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:34.111098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=25 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:22:44.228459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058b2ff-ecf2-49ce-960f-3b65dba5bf01 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:22:44.229447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058b2ff-ecf2-49ce-960f-3b65dba5bf01 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:22:44.230047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058b2ff-ecf2-49ce-960f-3b65dba5bf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:22:44.256718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4058b2ff-ecf2-49ce-960f-3b65dba5bf01 None None] MFA Rules not processed for user `5ebbd67cca66411ea52e4b92478564cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:22:44.256718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4058b2ff-ecf2-49ce-960f-3b65dba5bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:22:44.267269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1115/2234] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:22:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:22:54.246744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:08.589752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c5d36-89d7-477c-99fc-3b17fb49f78d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:08.590261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c5d36-89d7-477c-99fc-3b17fb49f78d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:08.590365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c5d36-89d7-477c-99fc-3b17fb49f78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:08.608019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-345c5d36-89d7-477c-99fc-3b17fb49f78d None None] MFA Rules not processed for user `6935dece64c14ab28be74275d43f07ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:23:08.613632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-345c5d36-89d7-477c-99fc-3b17fb49f78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:08.664406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1120/2235] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:23:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:23:17.426240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058b2ff-ecf2-49ce-960f-3b65dba5bf01 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:17.436689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058b2ff-ecf2-49ce-960f-3b65dba5bf01 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:17.440625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54972-0c66-4159-af38-91037554976b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:17.441267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54972-0c66-4159-af38-91037554976b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:17.441550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54972-0c66-4159-af38-91037554976b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:17.441825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54972-0c66-4159-af38-91037554976b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:17.444393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-94a54972-0c66-4159-af38-91037554976b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:17.457894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54972-0c66-4159-af38-91037554976b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:17.459448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54972-0c66-4159-af38-91037554976b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:17.470331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1116/2236] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:18.657361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=25 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:24.503040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c5d36-89d7-477c-99fc-3b17fb49f78d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:24.512791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c5d36-89d7-477c-99fc-3b17fb49f78d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:24.516381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:24.517006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:24.517291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:24.517564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:24.519312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:24.532470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:24.533877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:24.545140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1121/2237] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:27.465656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:34.540473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:35.254427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54972-0c66-4159-af38-91037554976b service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:35.255862 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-94a54972-0c66-4159-af38-91037554976b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:35.291449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54972-0c66-4159-af38-91037554976b service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:35.295158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:35.295794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:35.296080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:35.296395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:35.298162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:35.358036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:35.359476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:35.369187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1117/2238] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:36.119677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:36.121092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:36.135795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bcc50-b326-422f-8e2d-147b4f666756 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:36.141411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:36.142039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:36.142317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:36.142591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:36.144361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:36.155563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:36.157266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:36.167493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1122/2239] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:37.952354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:37.961291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eeb5c-898a-411c-806b-ec723d388404 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:37.965830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:37.966411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:37.966689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:37.967144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:37.969278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:37.982094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:37.983582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:37.995729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1118/2240] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:38.733943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:38.746729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b4e5-454c-4497-bef9-d332936f7001 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:38.755227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:38.756160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:38.756477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:38.756902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] PATH_INFO: `/v3/users/69533891e4cf463bb3fe9ac5cf7f4215` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:38.758101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69533891e4cf463bb3fe9ac5cf7f4215)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:38.760729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:38.999077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69533891e4cf463bb3fe9ac5cf7f4215'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.005835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69533891e4cf463bb3fe9ac5cf7f4215'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.006495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69533891e4cf463bb3fe9ac5cf7f4215'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.007103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69533891e4cf463bb3fe9ac5cf7f4215'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.019107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d217a43d-a027-4e59-8bce-b87b58acdbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69533891e4cf463bb3fe9ac5cf7f4215'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.126395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1123/2241] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:23:38 2022] DELETE /identity/v3/users/69533891e4cf463bb3fe9ac5cf7f4215 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:23:39.423650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:39.439165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b7470-8eda-499c-819d-4b4439d894e2 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:39.521318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:39.522788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:39.523219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:39.523698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] PATH_INFO: `/v3/projects/dae6efd4ad46479cb965caa8a97a772a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:39.525464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae6efd4ad46479cb965caa8a97a772a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:39.527608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:39.674809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae6efd4ad46479cb965caa8a97a772a', 'request_id': 'req-f7636576-b976-41c3-9ea7-646f9af7dabe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.682504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae6efd4ad46479cb965caa8a97a772a', 'request_id': 'req-f7636576-b976-41c3-9ea7-646f9af7dabe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.769004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae6efd4ad46479cb965caa8a97a772a', 'request_id': 'req-f7636576-b976-41c3-9ea7-646f9af7dabe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.771346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:39.791892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] The token cache is being invalidate because project dae6efd4ad46479cb965caa8a97a772a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:23:39.792190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.792893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:23:39.794943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1119/2242] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:23:39 2022] DELETE /identity/v3/projects/dae6efd4ad46479cb965caa8a97a772a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:23:44.823493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:44.824023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:44.824023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:44.842109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] MFA Rules not processed for user `b3345cc7b11246358bb1f5babd054e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:23:44.843298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:44.900219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1124/2243] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:23:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:23:45.263995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:45.265589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:45.330668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7636576-b976-41c3-9ea7-646f9af7dabe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:45.334331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:45.335097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:45.335442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:45.335783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:45.338129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:45.348063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:45.349623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:45.359999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1120/2244] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:45.788358 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:45.789909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:45.875447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a852747-bebf-46fb-a3ec-ffdbf85cc3a3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:45.880637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39006ff-1219-4a2d-8ad9-7f2306ad02a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:45.881283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39006ff-1219-4a2d-8ad9-7f2306ad02a9 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:45.881565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39006ff-1219-4a2d-8ad9-7f2306ad02a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:45.881839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39006ff-1219-4a2d-8ad9-7f2306ad02a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:45.883614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f39006ff-1219-4a2d-8ad9-7f2306ad02a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:45.892429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:45.896495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39006ff-1219-4a2d-8ad9-7f2306ad02a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:45.898168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39006ff-1219-4a2d-8ad9-7f2306ad02a9 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:45.909975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1125/2245] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:53.094146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:53.095710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:53.106303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c66d8-d457-48ae-b457-8ddbfacb2f59 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:53.109988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:53.110616 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:53.110898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:53.111193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:53.112925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:53.123004 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:53.124537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:53.132869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1121/2246] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:23:56.061088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:23:57.574729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5648a0-3377-4730-be03-39dcb01f7383 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:57.575837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5648a0-3377-4730-be03-39dcb01f7383 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:57.576654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5648a0-3377-4730-be03-39dcb01f7383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:57.599059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:57.600725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:57.633194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4b5648a0-3377-4730-be03-39dcb01f7383 None None] MFA Rules not processed for user `01fe8c57517d4ca5958ec13139aa2b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:23:57.636918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b5648a0-3377-4730-be03-39dcb01f7383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:57.738926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7cc6c-5146-4d30-b8f7-ee5db12115d4 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:57.745854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1126/2247] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:23:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:23:57.753939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:57.758571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:57.760922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:57.761348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:57.766655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:57.784061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:57.785818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:57.812263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1122/2248] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:23:58.161108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5648a0-3377-4730-be03-39dcb01f7383 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:23:58.180564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5648a0-3377-4730-be03-39dcb01f7383 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:23:58.180564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:23:58.180564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:23:58.180564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:23:58.181026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:23:58.181026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:23:58.190203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:23:58.191644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:23:58.201303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1127/2249] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:23:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:07.120733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:07.135433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdbba0-5548-4537-bf66-bd28bf5eefe0 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:07.143010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78a3d6-6eda-4da2-850a-b27ae9d6f4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:07.143860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78a3d6-6eda-4da2-850a-b27ae9d6f4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:07.149322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78a3d6-6eda-4da2-850a-b27ae9d6f4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:07.149322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78a3d6-6eda-4da2-850a-b27ae9d6f4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:07.149322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1b78a3d6-6eda-4da2-850a-b27ae9d6f4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:07.232628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78a3d6-6eda-4da2-850a-b27ae9d6f4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:07.234784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78a3d6-6eda-4da2-850a-b27ae9d6f4f4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:07.247026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1123/2250] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:08.185279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:08.210598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b905e-1d87-4a94-a769-fa40b23eeb42 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:08.230768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:08.231982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:08.232530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:08.233038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:08.237042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:08.255629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:08.258163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:08.274369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1128/2251] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:24:09.977253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:09.979660 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:09.980378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:09.989237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:10.002253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] MFA Rules not processed for user `633cfb032a0344619f95e72492e85b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:10.003678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:10.066177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1124/2252] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:12.084552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:12.086546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:12.100857 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067da3-754c-4e5c-b093-03b622c4e3d8 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:12.106474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:12.107320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:12.107756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:12.108186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:12.110427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:12.123745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:12.129355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:12.137604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1129/2253] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:12.251699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:12.253293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:12.268892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2cb2-28a0-4a92-92f5-3d15b0dcb576 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:12.273568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:12.274432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:12.274717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:12.274996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] PATH_INFO: `/v3/users/5ebbd67cca66411ea52e4b92478564cf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:12.276248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebbd67cca66411ea52e4b92478564cf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:12.278217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:12.462702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebbd67cca66411ea52e4b92478564cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:12.475374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebbd67cca66411ea52e4b92478564cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:12.482864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebbd67cca66411ea52e4b92478564cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:12.483635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebbd67cca66411ea52e4b92478564cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:12.614900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-58a99425-1a0e-4ccb-86d0-b48b31687615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebbd67cca66411ea52e4b92478564cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:12.622176 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1125/2254] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:24:12 2022] DELETE /identity/v3/users/5ebbd67cca66411ea52e4b92478564cf => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:12.855539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:12.863173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10fe84-3962-453f-99dc-24366e9030af service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:12.928793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:12.929771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:12.930054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:12.930321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] PATH_INFO: `/v3/projects/e79436f86e1e4038a7b0e41cf468bb62` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:12.931665 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79436f86e1e4038a7b0e41cf468bb62)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:12.934235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:13.063300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79436f86e1e4038a7b0e41cf468bb62', 'request_id': 'req-013e4889-6399-4782-9336-774b6fe1f14b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:13.191657 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79436f86e1e4038a7b0e41cf468bb62', 'request_id': 'req-013e4889-6399-4782-9336-774b6fe1f14b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:13.199561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79436f86e1e4038a7b0e41cf468bb62', 'request_id': 'req-013e4889-6399-4782-9336-774b6fe1f14b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:13.204647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:13.214296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] The token cache is being invalidate because project e79436f86e1e4038a7b0e41cf468bb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:24:13.214589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:13.215253 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-013e4889-6399-4782-9336-774b6fe1f14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:13.217525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1130/2255] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:24:12 2022] DELETE /identity/v3/projects/e79436f86e1e4038a7b0e41cf468bb62 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:13.228971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5df69-d56a-4efa-99ae-5795f176cbd6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.229774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5df69-d56a-4efa-99ae-5795f176cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.230281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5df69-d56a-4efa-99ae-5795f176cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.249018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6ad5df69-d56a-4efa-99ae-5795f176cbd6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:13.250355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6ad5df69-d56a-4efa-99ae-5795f176cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:13.328355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1126/2256] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:24:13.334373 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136b554-e4d5-4901-a0b4-bf358f2e0067 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.334772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136b554-e4d5-4901-a0b4-bf358f2e0067 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.335169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136b554-e4d5-4901-a0b4-bf358f2e0067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.355822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a136b554-e4d5-4901-a0b4-bf358f2e0067 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:13.357147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a136b554-e4d5-4901-a0b4-bf358f2e0067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:13.368760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1131/2257] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:24:13.379364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5df69-d56a-4efa-99ae-5795f176cbd6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:13.391229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5df69-d56a-4efa-99ae-5795f176cbd6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:13.396097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:13.397216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.397216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.397418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.398063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:24:13.398375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:13.399981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:13.412716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1127/2258] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:24:13.417697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136b554-e4d5-4901-a0b4-bf358f2e0067 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:13.427212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136b554-e4d5-4901-a0b4-bf358f2e0067 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:13.432537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:13.433608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.433890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.434155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.434838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:13.436957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:13.539567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1132/2259] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:24:13.540713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:13.551003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc064f-7707-41cd-b01b-befa57becb55 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:13.555544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:13.608578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:13.609255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.609564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.609844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.610550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:13.612537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:13.745680 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1128/2260] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:24:13 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:24:13.750035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:13.765169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf266b-0f44-4d78-bd5c-b05042f0848e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:13.770219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:13.770902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.771181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.771479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.772223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:13.773841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:13.787605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1133/2261] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:24:13.790318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:13.801708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277685-3018-476a-b199-cdf155fc40a6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:13.806655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12c8ca-0e72-4b65-b8df-1e094f7d9007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:13.808253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12c8ca-0e72-4b65-b8df-1e094f7d9007 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.808580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12c8ca-0e72-4b65-b8df-1e094f7d9007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.808853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12c8ca-0e72-4b65-b8df-1e094f7d9007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.809582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12c8ca-0e72-4b65-b8df-1e094f7d9007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:13.811178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12c8ca-0e72-4b65-b8df-1e094f7d9007 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:13.824123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1129/2262] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:13.833502 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:13.841352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617969c-7ea7-4107-931c-ba78c7e2d573 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:13.846120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:13.847012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.847294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.847570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] PATH_INFO: `/v3/projects/9ba1bb028809433dbda6fd92dff46d1b/users/b0bc05fef71d40409406ce024b33b4bc/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.869285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba1bb028809433dbda6fd92dff46d1b, user_id=b0bc05fef71d40409406ce024b33b4bc, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:13.872332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:13.951856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1134/2263] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:24:13 2022] PUT /identity/v3/projects/9ba1bb028809433dbda6fd92dff46d1b/users/b0bc05fef71d40409406ce024b33b4bc/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:24:13.961742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:13.962227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:13.962503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:13.989410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:13.991189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:13.994794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] MFA Rules not processed for user `b0bc05fef71d40409406ce024b33b4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:13.995985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:14.065138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1130/2264] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:14.076684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:14.078044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:14.087939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565009b-2013-427c-84ad-d009cb78ee3f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:14.095989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81179a68-1ccc-44a0-9ece-bdf5defb13f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:14.096688 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179a68-1ccc-44a0-9ece-bdf5defb13f7 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:14.096972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179a68-1ccc-44a0-9ece-bdf5defb13f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:14.097213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d73f8b-f5f5-41dd-8cb5-401f57fefbe0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:14.097353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179a68-1ccc-44a0-9ece-bdf5defb13f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:14.099183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-81179a68-1ccc-44a0-9ece-bdf5defb13f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:14.102949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:14.103626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:14.103914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:14.104331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:14.114415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:14.115398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:14.126317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1131/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:24:14.176766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81179a68-1ccc-44a0-9ece-bdf5defb13f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:14.179080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81179a68-1ccc-44a0-9ece-bdf5defb13f7 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:14.190281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1135/2266] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:14.509099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:14.588985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b70c-aeb6-4401-8e82-382e2e1a6595 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:14.594442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:14.595498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:14.595781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:14.596219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] PATH_INFO: `/v3/users/b0bc05fef71d40409406ce024b33b4bc` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:14.598006 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bc05fef71d40409406ce024b33b4bc)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:14.599953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:14.607075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:14.908655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bc05fef71d40409406ce024b33b4bc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:14.927745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bc05fef71d40409406ce024b33b4bc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:14.941688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bc05fef71d40409406ce024b33b4bc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:14.942651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bc05fef71d40409406ce024b33b4bc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:15.008904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bc05fef71d40409406ce024b33b4bc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:15.016928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1132/2267] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:24:14 2022] DELETE /identity/v3/users/b0bc05fef71d40409406ce024b33b4bc => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:15.021669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:15.022126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:15.022257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:15.041900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:15.043201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:15.069258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:15.103121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1136/2268] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:15.113497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:15.114870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:15.172704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a0d88-88e2-49c9-a7e0-59782ca6c3c1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:15.176284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef561998-1a9c-45e5-81e3-6ff7700edf9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:15.176923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef561998-1a9c-45e5-81e3-6ff7700edf9a service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:15.177234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef561998-1a9c-45e5-81e3-6ff7700edf9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:15.177507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef561998-1a9c-45e5-81e3-6ff7700edf9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:15.186884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef561998-1a9c-45e5-81e3-6ff7700edf9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:15.188349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef561998-1a9c-45e5-81e3-6ff7700edf9a service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:15.197871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1133/2269] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:15.698982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:15.700742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:15.714811 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79045247-02c3-4fd3-aea0-d1790ff6a82b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:15.721194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:15.725508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:15.725508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:15.725508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] PATH_INFO: `/v3/projects/9ba1bb028809433dbda6fd92dff46d1b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:15.725508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba1bb028809433dbda6fd92dff46d1b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:15.726445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:15.848673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba1bb028809433dbda6fd92dff46d1b', 'request_id': 'req-aa30b203-04bd-4642-b355-b2e8b1dece18'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:15.928788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba1bb028809433dbda6fd92dff46d1b', 'request_id': 'req-aa30b203-04bd-4642-b355-b2e8b1dece18'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:15.936333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba1bb028809433dbda6fd92dff46d1b', 'request_id': 'req-aa30b203-04bd-4642-b355-b2e8b1dece18'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:15.946999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] The token cache is being invalidate because project 9ba1bb028809433dbda6fd92dff46d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:24:15.947463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:15.948084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa30b203-04bd-4642-b355-b2e8b1dece18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:15.949663 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1137/2270] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:24:15 2022] DELETE /identity/v3/projects/9ba1bb028809433dbda6fd92dff46d1b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:15.954423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d898d-2b4a-40c9-83ab-6dad24ed3f24 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:15.954877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d898d-2b4a-40c9-83ab-6dad24ed3f24 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:15.954970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d898d-2b4a-40c9-83ab-6dad24ed3f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:15.973721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0b1d898d-2b4a-40c9-83ab-6dad24ed3f24 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:15.974915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0b1d898d-2b4a-40c9-83ab-6dad24ed3f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:16.050997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1134/2271] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:16.060325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32627c-f8ef-4364-a67f-674b7d979898 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.060814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32627c-f8ef-4364-a67f-674b7d979898 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.060923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32627c-f8ef-4364-a67f-674b7d979898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.080112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4e32627c-f8ef-4364-a67f-674b7d979898 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:16.081338 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4e32627c-f8ef-4364-a67f-674b7d979898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:16.090282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1138/2272] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:16.094760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d898d-2b4a-40c9-83ab-6dad24ed3f24 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.104770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d898d-2b4a-40c9-83ab-6dad24ed3f24 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:16.109401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:16.110289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.113577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.113577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.113577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:24:16.113577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:16.113577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:16.125946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1135/2273] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:24:16.130240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32627c-f8ef-4364-a67f-674b7d979898 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.140147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32627c-f8ef-4364-a67f-674b7d979898 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:16.145102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:16.145749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.146028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.146333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.147017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:16.149040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:16.252556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1139/2274] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:24:16 2022] POST /identity/v3/projects => generated 357 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:24:16.253716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.264771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3066d1b-9f8a-4c35-82d0-dccc1c32ac2c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:16.274440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:16.324974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:16.325824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.326111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.326389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.327081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:16.329102 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:16.418490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1136/2275] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:24:16 2022] POST /identity/v3/users => generated 279 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:24:16.419694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.430191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389341dd-702b-434c-88e7-fbcc44e35c9b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:16.435658 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:16.436372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.443883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.443883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.443883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:16.443883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:16.451003 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1140/2276] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:16.454860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.465068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef99da-1be6-4867-81f8-8898e0c2080e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:16.469736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4356fb-109c-4e7a-9f4a-2fae36affd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:16.470382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4356fb-109c-4e7a-9f4a-2fae36affd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.470663 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4356fb-109c-4e7a-9f4a-2fae36affd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.470940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4356fb-109c-4e7a-9f4a-2fae36affd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.471692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4356fb-109c-4e7a-9f4a-2fae36affd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:16.473308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4356fb-109c-4e7a-9f4a-2fae36affd8b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:16.483672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1137/2277] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:16.488214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.499134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467f5b-d67c-477d-86a0-0b2227ff531e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:16.503753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:16.504656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.504938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.505216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] PATH_INFO: `/v3/projects/5ec47b506edc4d579f97d20f198865e5/users/d79e39b4a31a4d78bac7e536f17d1aec/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.521121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec47b506edc4d579f97d20f198865e5, user_id=d79e39b4a31a4d78bac7e536f17d1aec, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:16.523884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:16.627123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1141/2278] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:24:16 2022] PUT /identity/v3/projects/5ec47b506edc4d579f97d20f198865e5/users/d79e39b4a31a4d78bac7e536f17d1aec/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:16.638038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15b43-2d85-4859-8280-555718ffdb59 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.638331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15b43-2d85-4859-8280-555718ffdb59 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.638616 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15b43-2d85-4859-8280-555718ffdb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.668449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-42c15b43-2d85-4859-8280-555718ffdb59 None None] MFA Rules not processed for user `d79e39b4a31a4d78bac7e536f17d1aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:16.670013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-42c15b43-2d85-4859-8280-555718ffdb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:16.739358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1138/2279] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:16.744618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.794313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:16.807893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71824e-4a98-424a-8320-f66333a7bfcc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:16.812937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:16.813584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:16.813863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:16.814136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:16.814826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:16.816760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:16.914385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1142/2280] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:24:16 2022] POST /identity/v3/projects => generated 357 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:24:16.918700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c15b43-2d85-4859-8280-555718ffdb59 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:16.932389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c15b43-2d85-4859-8280-555718ffdb59 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:17.002186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:17.002186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.002186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.002186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.002991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:17.002991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:17.079256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1139/2281] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:24:16 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:24:17.081453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:17.092423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba8da1-701a-467f-9a7e-33698be2fd6f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:17.097191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:17.097847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.098128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.098402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.099168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:17.100786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:17.112613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1143/2282] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:17.116814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:17.127658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37c20-3e6e-4d8a-a447-10bd2347e0ba admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:17.132276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:17.133155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.133431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.133706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] PATH_INFO: `/v3/projects/e4b9d37b99c5414d88230e06e26ede18/users/a5b33a2aa1474635b9bb60b368d93e12/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.144589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:17.151635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b9d37b99c5414d88230e06e26ede18, user_id=a5b33a2aa1474635b9bb60b368d93e12, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:17.154692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:17.246759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1140/2283] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:24:17 2022] PUT /identity/v3/projects/e4b9d37b99c5414d88230e06e26ede18/users/a5b33a2aa1474635b9bb60b368d93e12/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:24:17.250651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:17.261716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef906-1c15-4dcb-a48b-00b665989637 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:17.320248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927401e2-c8bd-429b-ab2e-13a2ff762279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:17.320911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927401e2-c8bd-429b-ab2e-13a2ff762279 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.321189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927401e2-c8bd-429b-ab2e-13a2ff762279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.324137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927401e2-c8bd-429b-ab2e-13a2ff762279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.324137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927401e2-c8bd-429b-ab2e-13a2ff762279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:17.324137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927401e2-c8bd-429b-ab2e-13a2ff762279 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:17.334494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1144/2284] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:17.339325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:17.350191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf58dab-657e-42a7-965a-5dc43d8b4d2f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:17.355209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:17.356125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.356407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.356682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] PATH_INFO: `/v3/projects/e4b9d37b99c5414d88230e06e26ede18/users/a5b33a2aa1474635b9bb60b368d93e12/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.358759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b9d37b99c5414d88230e06e26ede18, user_id=a5b33a2aa1474635b9bb60b368d93e12, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:17.361445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:17.373789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1141/2285] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:24:17 2022] PUT /identity/v3/projects/e4b9d37b99c5414d88230e06e26ede18/users/a5b33a2aa1474635b9bb60b368d93e12/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:24:17.383752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b54b-6f4f-4b76-8dc9-8449aa4fd0fe None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.384040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b54b-6f4f-4b76-8dc9-8449aa4fd0fe None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.384354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b54b-6f4f-4b76-8dc9-8449aa4fd0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.411276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d6a3b54b-6f4f-4b76-8dc9-8449aa4fd0fe None None] MFA Rules not processed for user `a5b33a2aa1474635b9bb60b368d93e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:17.412523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d6a3b54b-6f4f-4b76-8dc9-8449aa4fd0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:17.483768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1145/2286] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:17.495507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:17.497490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:17.554958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0ea3-cd06-4a35-89db-867302fdb6ab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:17.559642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:17.560319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.560605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.560885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.570270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:17.571868 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:17.581709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1142/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:17.775575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3b54b-6f4f-4b76-8dc9-8449aa4fd0fe None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:17.785941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3b54b-6f4f-4b76-8dc9-8449aa4fd0fe None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:17.789744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18831f74-e84d-45ef-8f22-9c142c01d404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:17.790393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18831f74-e84d-45ef-8f22-9c142c01d404 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:17.790673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18831f74-e84d-45ef-8f22-9c142c01d404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:17.791521 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18831f74-e84d-45ef-8f22-9c142c01d404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:17.835659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:17.851013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18831f74-e84d-45ef-8f22-9c142c01d404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:17.852461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18831f74-e84d-45ef-8f22-9c142c01d404 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:17.862825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1146/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:19.713501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:19.718014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:19.794981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9956b98-adce-4cf5-9da0-cbd4c55e1781 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:19.800593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:19.801239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:19.801523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:19.801801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:19.803564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:19.816781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:19.818012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:19.830112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1143/2289] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:27.937284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=8 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:29.825120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:30.610528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c74e-2dcb-4b84-9f83-d3f5e979c800 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:30.611117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c74e-2dcb-4b84-9f83-d3f5e979c800 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:30.611117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c74e-2dcb-4b84-9f83-d3f5e979c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:30.629288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0744c74e-2dcb-4b84-9f83-d3f5e979c800 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:30.630468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0744c74e-2dcb-4b84-9f83-d3f5e979c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:30.687662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1147/2290] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:24:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:30.867698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:30.869182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:30.949597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc3204-a39b-48b7-958b-0015aa89a292 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:30.954673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c07d98-5277-48bf-a5a7-4aca5e4bdd35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:30.955338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07d98-5277-48bf-a5a7-4aca5e4bdd35 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:30.955632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07d98-5277-48bf-a5a7-4aca5e4bdd35 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:30.955898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07d98-5277-48bf-a5a7-4aca5e4bdd35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:30.968048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c07d98-5277-48bf-a5a7-4aca5e4bdd35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:30.969668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c07d98-5277-48bf-a5a7-4aca5e4bdd35 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:30.978034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1144/2291] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:24:37.646169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744c74e-2dcb-4b84-9f83-d3f5e979c800 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:37.749863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744c74e-2dcb-4b84-9f83-d3f5e979c800 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:37.754497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:37.755359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:37.755750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:37.756031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] PATH_INFO: `/v3/users/d79e39b4a31a4d78bac7e536f17d1aec` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:37.757331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79e39b4a31a4d78bac7e536f17d1aec)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:37.761222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:38.005800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79e39b4a31a4d78bac7e536f17d1aec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:38.019239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79e39b4a31a4d78bac7e536f17d1aec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:38.020210 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79e39b4a31a4d78bac7e536f17d1aec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:38.020911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79e39b4a31a4d78bac7e536f17d1aec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:38.039511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79e39b4a31a4d78bac7e536f17d1aec'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:38.149856 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1148/2292] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:24:37 2022] DELETE /identity/v3/users/d79e39b4a31a4d78bac7e536f17d1aec => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:38.154499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:38.155010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:38.155103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:38.175777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:38.178942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:38.247046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1145/2293] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:24:38.257497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:38.258923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:38.291006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:38.331689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598904a-987c-4bf6-b702-953e75b0b75b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:38.339631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:38.340454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:38.340806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:38.343490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:38.364485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:38.365925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:38.380018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1149/2294] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:24:38.875882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:38.877750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:38.894922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907828-aca1-4d9b-bfc1-2085d993d924 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:38.901313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:38.902405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:38.902856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:38.903238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] PATH_INFO: `/v3/projects/5ec47b506edc4d579f97d20f198865e5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:38.916466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec47b506edc4d579f97d20f198865e5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:38.922614 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:39.095603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec47b506edc4d579f97d20f198865e5', 'request_id': 'req-d01236fe-e82b-4370-8136-7ef3ee52099e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.102503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec47b506edc4d579f97d20f198865e5', 'request_id': 'req-d01236fe-e82b-4370-8136-7ef3ee52099e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.155416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec47b506edc4d579f97d20f198865e5', 'request_id': 'req-d01236fe-e82b-4370-8136-7ef3ee52099e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.171959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] The token cache is being invalidate because project 5ec47b506edc4d579f97d20f198865e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:24:39.172407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.173103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.174711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1146/2295] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:24:38 2022] DELETE /identity/v3/projects/5ec47b506edc4d579f97d20f198865e5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:39.182547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:39.193987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696f72d-4419-47e9-bebe-14f32fa3965c service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:39.271109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:39.271996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:39.272341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:39.272730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] PATH_INFO: `/v3/users/a5b33a2aa1474635b9bb60b368d93e12` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:39.273939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b33a2aa1474635b9bb60b368d93e12)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:39.276867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:39.449602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b33a2aa1474635b9bb60b368d93e12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.459975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b33a2aa1474635b9bb60b368d93e12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.460739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b33a2aa1474635b9bb60b368d93e12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.461434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b33a2aa1474635b9bb60b368d93e12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.477873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c573fa09-6fb8-4dd2-a0b2-8d124e3a308b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b33a2aa1474635b9bb60b368d93e12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:39.556512 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1150/2296] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:24:39 2022] DELETE /identity/v3/users/a5b33a2aa1474635b9bb60b368d93e12 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:39.984331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:39.987861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:40.000807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:40.016977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01236fe-e82b-4370-8136-7ef3ee52099e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:40.093162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:40.094534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:40.094957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:40.095337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] PATH_INFO: `/v3/projects/e4b9d37b99c5414d88230e06e26ede18` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:40.097112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b9d37b99c5414d88230e06e26ede18)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:40.102833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:40.211971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b9d37b99c5414d88230e06e26ede18', 'request_id': 'req-052fb115-de80-417a-90a3-a26e4be8deeb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:40.220010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b9d37b99c5414d88230e06e26ede18', 'request_id': 'req-052fb115-de80-417a-90a3-a26e4be8deeb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:40.898174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b9d37b99c5414d88230e06e26ede18', 'request_id': 'req-052fb115-de80-417a-90a3-a26e4be8deeb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:40.910789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] The token cache is being invalidate because project e4b9d37b99c5414d88230e06e26ede18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:24:40.911082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:40.911732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-052fb115-de80-417a-90a3-a26e4be8deeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:24:40.913358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1147/2297] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:24:39 2022] DELETE /identity/v3/projects/e4b9d37b99c5414d88230e06e26ede18 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:40.918571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe6d97-3b75-4658-b0c3-ff69c691328d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:40.919200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe6d97-3b75-4658-b0c3-ff69c691328d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:40.919200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe6d97-3b75-4658-b0c3-ff69c691328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:40.939221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-02fe6d97-3b75-4658-b0c3-ff69c691328d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:40.940435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-02fe6d97-3b75-4658-b0c3-ff69c691328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:40.993625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:41.030379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1151/2298] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:41.032536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3a0f-c350-4d5c-a738-100aeba1b416 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3a0f-c350-4d5c-a738-100aeba1b416 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.038892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3a0f-c350-4d5c-a738-100aeba1b416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.054957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-83ba3a0f-c350-4d5c-a738-100aeba1b416 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:41.056278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-83ba3a0f-c350-4d5c-a738-100aeba1b416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:41.070081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1148/2299] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:41.071345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe6d97-3b75-4658-b0c3-ff69c691328d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:41.082685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe6d97-3b75-4658-b0c3-ff69c691328d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:41.093139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:41.094416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.094867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.095643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.096457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:24:41.096759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:41.098362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:41.116602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1152/2300] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:24:41.121712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3a0f-c350-4d5c-a738-100aeba1b416 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:41.133177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3a0f-c350-4d5c-a738-100aeba1b416 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:41.139517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:41.140267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.140564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.140842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.141537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:41.143485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:41.268278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1149/2301] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:24:41 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:24:41.272694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:41.283939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd36d8-57bb-4a2f-a340-4374919ad9b2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:41.367348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:41.368728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.369019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.369416 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.370137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:41.373182 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:41.458914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1153/2302] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:24:41 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:24:41.463016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:41.473955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634f8a-43ca-4bae-bbf2-dd21b2bf792d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:41.478819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:41.479475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.479755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.480026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.481463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:41.483215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:41.493780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1150/2303] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:41.498711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:41.509561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695554-4006-439f-bbb0-d3654b98baf3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:41.514824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfdeaf-2be1-4b67-8d22-4ef372ed3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:41.515580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfdeaf-2be1-4b67-8d22-4ef372ed3779 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.515865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfdeaf-2be1-4b67-8d22-4ef372ed3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.516140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfdeaf-2be1-4b67-8d22-4ef372ed3779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.516914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfdeaf-2be1-4b67-8d22-4ef372ed3779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:41.518570 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfdeaf-2be1-4b67-8d22-4ef372ed3779 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:41.529595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1154/2304] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:24:41.533912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:41.546596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a22f73-d102-4580-a58d-2c6f594e4d3f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:41.555824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:41.556770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.557058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.557336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] PATH_INFO: `/v3/projects/574b19ff5bb745419797be77c4d7e0ec/users/764efa6492b7409da3f944c3e685756e/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.579931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574b19ff5bb745419797be77c4d7e0ec, user_id=764efa6492b7409da3f944c3e685756e, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:41.583012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:41.801364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1151/2305] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:24:41 2022] PUT /identity/v3/projects/574b19ff5bb745419797be77c4d7e0ec/users/764efa6492b7409da3f944c3e685756e/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:24:41.812432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d853c-3d74-4e3d-bc13-8c08b92d5fe8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.812720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d853c-3d74-4e3d-bc13-8c08b92d5fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.813025 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d853c-3d74-4e3d-bc13-8c08b92d5fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.841193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a51d853c-3d74-4e3d-bc13-8c08b92d5fe8 None None] MFA Rules not processed for user `764efa6492b7409da3f944c3e685756e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:41.842396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a51d853c-3d74-4e3d-bc13-8c08b92d5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:41.906671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1155/2306] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:41.911084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:41.932119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:41.975624 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c238-6dba-4a39-8b25-f76e5ea3cd63 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:41.980560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:41.983541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:41.983541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:41.983541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:41.983541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:41.985147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:42.110497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1152/2307] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:24:41 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:24:42.111853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d853c-3d74-4e3d-bc13-8c08b92d5fe8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:42.123553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d853c-3d74-4e3d-bc13-8c08b92d5fe8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:42.164401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:42.181779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:42.182525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:42.182808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:42.183332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:42.184820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:42.186862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:42.275424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1156/2308] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:24:42 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:24:42.279296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:42.289844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e0fc-2b2e-4786-8b7b-8f8126a51785 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:42.295068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:42.295716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:42.295998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:42.296320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:42.297051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:42.298645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:42.310062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1153/2309] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:42.314038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:42.323998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6e661-7200-44b1-b23b-03e07cbc4319 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:42.328861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:42.329842 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:42.330169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:42.330446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] PATH_INFO: `/v3/projects/cf3eed4e5f754419ba18f2fec4fb9734/users/e1abcade4227465882ae97eb818eb60c/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:42.345397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3eed4e5f754419ba18f2fec4fb9734, user_id=e1abcade4227465882ae97eb818eb60c, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:42.348054 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:42.419292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1157/2310] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:24:42 2022] PUT /identity/v3/projects/cf3eed4e5f754419ba18f2fec4fb9734/users/e1abcade4227465882ae97eb818eb60c/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:42.423297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:42.435578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad178c-67d2-428f-b841-8f499a8ec6b6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:42.493700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a0655-6519-4acb-b598-ac17ca0a6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:42.494361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a0655-6519-4acb-b598-ac17ca0a6581 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:42.494640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a0655-6519-4acb-b598-ac17ca0a6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:42.494911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a0655-6519-4acb-b598-ac17ca0a6581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:42.495664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a0655-6519-4acb-b598-ac17ca0a6581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:42.498086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a0655-6519-4acb-b598-ac17ca0a6581 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:42.508539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1154/2311] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:24:42.513177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:42.524026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd3d0-88d5-4392-aa07-52f95d007cae admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:42.529626 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:42.530503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:42.530829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:42.531106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] PATH_INFO: `/v3/projects/cf3eed4e5f754419ba18f2fec4fb9734/users/e1abcade4227465882ae97eb818eb60c/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:42.533144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3eed4e5f754419ba18f2fec4fb9734, user_id=e1abcade4227465882ae97eb818eb60c, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:42.535853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:42.548586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1158/2312] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:24:42 2022] PUT /identity/v3/projects/cf3eed4e5f754419ba18f2fec4fb9734/users/e1abcade4227465882ae97eb818eb60c/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:24:42.559525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd108e0-72a1-4515-8430-a835b259b5cb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:42.559871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd108e0-72a1-4515-8430-a835b259b5cb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:42.560182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd108e0-72a1-4515-8430-a835b259b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:42.588060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bbd108e0-72a1-4515-8430-a835b259b5cb None None] MFA Rules not processed for user `e1abcade4227465882ae97eb818eb60c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:42.589351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bbd108e0-72a1-4515-8430-a835b259b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:42.656552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1155/2313] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:24:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:42.667111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:42.668905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:42.725926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975f05-d8e8-47d3-a8e3-1aa1c3411e4e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:42.729584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7ffc-e9d5-4fc6-8915-0393c4b85b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:42.730215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7ffc-e9d5-4fc6-8915-0393c4b85b4f service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:42.730608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7ffc-e9d5-4fc6-8915-0393c4b85b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:42.730909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7ffc-e9d5-4fc6-8915-0393c4b85b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:42.787175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca7ffc-e9d5-4fc6-8915-0393c4b85b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:42.788664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca7ffc-e9d5-4fc6-8915-0393c4b85b4f service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:42.797553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1159/2314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:49.151187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035125-7e66-4b23-a71d-ea6c2b92d83b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.151731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035125-7e66-4b23-a71d-ea6c2b92d83b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.151864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035125-7e66-4b23-a71d-ea6c2b92d83b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.153469 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1156/2315] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:24:49.159485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885a69-9548-49ce-abbd-b2b2d6e0ae0d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.159971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885a69-9548-49ce-abbd-b2b2d6e0ae0d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.160078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885a69-9548-49ce-abbd-b2b2d6e0ae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.178206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-24885a69-9548-49ce-abbd-b2b2d6e0ae0d None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:49.179534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-24885a69-9548-49ce-abbd-b2b2d6e0ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:49.224109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:49.247445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1160/2316] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:49.258710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2035125-7e66-4b23-a71d-ea6c2b92d83b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:49.260490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c2035125-7e66-4b23-a71d-ea6c2b92d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:49.279853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:24:49.318550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2035125-7e66-4b23-a71d-ea6c2b92d83b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:49.322080 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3efa-f463-419f-9624-4d3f35d23d91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:49.324249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3efa-f463-419f-9624-4d3f35d23d91 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.324249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3efa-f463-419f-9624-4d3f35d23d91 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.324249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3efa-f463-419f-9624-4d3f35d23d91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.333407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3efa-f463-419f-9624-4d3f35d23d91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:49.334837 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3efa-f463-419f-9624-4d3f35d23d91 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:49.346491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1157/2317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:24:49.426802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885a69-9548-49ce-abbd-b2b2d6e0ae0d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:49.437074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885a69-9548-49ce-abbd-b2b2d6e0ae0d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:49.440909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d0a48-a691-4404-adc8-93f3a886a2e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:49.441585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0a48-a691-4404-adc8-93f3a886a2e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.441873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0a48-a691-4404-adc8-93f3a886a2e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.442155 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0a48-a691-4404-adc8-93f3a886a2e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.451630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d0a48-a691-4404-adc8-93f3a886a2e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:49.453100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d0a48-a691-4404-adc8-93f3a886a2e8 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:49.462438 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1161/2318] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:49.541280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edc49-7b4c-4d09-9575-4ca386c9ecfd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.541519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edc49-7b4c-4d09-9575-4ca386c9ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.541792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edc49-7b4c-4d09-9575-4ca386c9ecfd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.543174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1158/2319] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:24:49.549587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eece7d-5c13-4f52-9109-79f8a6107e4c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.549878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eece7d-5c13-4f52-9109-79f8a6107e4c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.550159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eece7d-5c13-4f52-9109-79f8a6107e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.574088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-54eece7d-5c13-4f52-9109-79f8a6107e4c None None] MFA Rules not processed for user `2d8183015eed4fd19e4a5fdf57d341e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:49.575478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-54eece7d-5c13-4f52-9109-79f8a6107e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:49.635887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1162/2320] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:49.648688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924edc49-7b4c-4d09-9575-4ca386c9ecfd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:49.650434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-924edc49-7b4c-4d09-9575-4ca386c9ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:49.664536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924edc49-7b4c-4d09-9575-4ca386c9ecfd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:49.668058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54817d-695e-45d6-bd90-461df53c96c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:49.668782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54817d-695e-45d6-bd90-461df53c96c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.669096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54817d-695e-45d6-bd90-461df53c96c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.669340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54817d-695e-45d6-bd90-461df53c96c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.676520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54817d-695e-45d6-bd90-461df53c96c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:49.678386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54817d-695e-45d6-bd90-461df53c96c8 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:49.686115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1159/2321] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:49.773501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff929c-5db5-42f2-b1c8-b40e5e6edf58 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.773826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff929c-5db5-42f2-b1c8-b40e5e6edf58 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.774110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff929c-5db5-42f2-b1c8-b40e5e6edf58 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.775488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1163/2322] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 08:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:24:49.781730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7641-5dbb-4eee-b32c-dad5649918ff None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.782023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7641-5dbb-4eee-b32c-dad5649918ff None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.782317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7641-5dbb-4eee-b32c-dad5649918ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.801671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-036e7641-5dbb-4eee-b32c-dad5649918ff None None] MFA Rules not processed for user `7602c632829d44179aa129c552d1870a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:49.802812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-036e7641-5dbb-4eee-b32c-dad5649918ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:49.812723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1160/2323] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:24:49.823244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff929c-5db5-42f2-b1c8-b40e5e6edf58 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:49.825583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6aff929c-5db5-42f2-b1c8-b40e5e6edf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:49.838623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff929c-5db5-42f2-b1c8-b40e5e6edf58 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:49.842817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:49.843423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:49.843703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:49.843976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:49.853985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:49.855372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:49.866121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1164/2324] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:24:55.175875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c72e7-5a7a-41c2-a8c5-852a080d2973 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:55.176386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c72e7-5a7a-41c2-a8c5-852a080d2973 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:55.176497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c72e7-5a7a-41c2-a8c5-852a080d2973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:55.195753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6e2c72e7-5a7a-41c2-a8c5-852a080d2973 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:24:55.196967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6e2c72e7-5a7a-41c2-a8c5-852a080d2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:55.252475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1161/2325] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:24:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:24:55.265495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:24:55.266079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:24:55.339772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619f48-cacb-443f-bccf-4b020348ea9d service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:24:55.345362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:24:55.346010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:24:55.346293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:24:55.346571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:24:55.354866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:24:55.357283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:24:55.365255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1165/2326] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:24:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:05.244752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=53 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:05.361920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=76 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:16.545717 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138859a-4df5-44f3-be17-c777b093d212 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:16.546256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138859a-4df5-44f3-be17-c777b093d212 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:16.546256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138859a-4df5-44f3-be17-c777b093d212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:16.564487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1138859a-4df5-44f3-be17-c777b093d212 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:16.565675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1138859a-4df5-44f3-be17-c777b093d212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:16.572788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1162/2327] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 08:25:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:16.586224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:16.597399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9ad66-bb13-44c7-aa2d-f3f20f7663d1 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:16.602824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d7df0-ab75-44bc-bf60-3e4bc7493507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:16.603495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7df0-ab75-44bc-bf60-3e4bc7493507 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:16.603784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7df0-ab75-44bc-bf60-3e4bc7493507 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:16.604116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7df0-ab75-44bc-bf60-3e4bc7493507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:16.613339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d7df0-ab75-44bc-bf60-3e4bc7493507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:16.614911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d7df0-ab75-44bc-bf60-3e4bc7493507 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:16.623335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1166/2328] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:25:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:25:17.314171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138859a-4df5-44f3-be17-c777b093d212 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:17.385503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138859a-4df5-44f3-be17-c777b093d212 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:17.390851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:17.391733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:17.392013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:17.392543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] PATH_INFO: `/v3/users/764efa6492b7409da3f944c3e685756e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:17.393511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764efa6492b7409da3f944c3e685756e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:17.395445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:17.631314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764efa6492b7409da3f944c3e685756e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:17.643532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764efa6492b7409da3f944c3e685756e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:17.650245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764efa6492b7409da3f944c3e685756e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:17.650916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764efa6492b7409da3f944c3e685756e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:17.794955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764efa6492b7409da3f944c3e685756e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:17.801903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1163/2329] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:17 2022] DELETE /identity/v3/users/764efa6492b7409da3f944c3e685756e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:17.806628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:17.807157 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:17.807256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:17.826348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:17.827537 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:17.913608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1167/2330] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:17.924064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:17.925630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:17.992507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07739b-bcfc-43ef-bcc1-dc150b4f1d02 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:17.996472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:17.997108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:17.997391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:17.997728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:18.007233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:18.008761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:18.018739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1164/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:18.501100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:18.501100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:18.511569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07321e3-ae76-4072-81fd-962cc4a41c87 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:18.517800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:18.518664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:18.518941 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:18.519411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] PATH_INFO: `/v3/projects/574b19ff5bb745419797be77c4d7e0ec` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:18.525426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574b19ff5bb745419797be77c4d7e0ec)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:18.529807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:18.681888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574b19ff5bb745419797be77c4d7e0ec', 'request_id': 'req-95f68ea4-90c0-4850-993d-1ccd511a2ff7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:18.778971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574b19ff5bb745419797be77c4d7e0ec', 'request_id': 'req-95f68ea4-90c0-4850-993d-1ccd511a2ff7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:18.785610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574b19ff5bb745419797be77c4d7e0ec', 'request_id': 'req-95f68ea4-90c0-4850-993d-1ccd511a2ff7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:18.796715 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] The token cache is being invalidate because project 574b19ff5bb745419797be77c4d7e0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:18.796998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:18.797700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:18.799530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1168/2332] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:18 2022] DELETE /identity/v3/projects/574b19ff5bb745419797be77c4d7e0ec => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:18.803558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:18.814247 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c960071-537b-415e-a518-213e20eeaafe service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:18.826001 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:18.871608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:18.872568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:18.873046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:18.873517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] PATH_INFO: `/v3/users/e1abcade4227465882ae97eb818eb60c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:18.875061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1abcade4227465882ae97eb818eb60c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:18.877033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:19.051363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1abcade4227465882ae97eb818eb60c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:19.064796 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1abcade4227465882ae97eb818eb60c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:19.075363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1abcade4227465882ae97eb818eb60c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:19.075363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1abcade4227465882ae97eb818eb60c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:19.161858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-30b1ed8b-3c7f-44cc-bffe-cf167d56e871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1abcade4227465882ae97eb818eb60c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:19.169801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1165/2333] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:18 2022] DELETE /identity/v3/users/e1abcade4227465882ae97eb818eb60c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:19.852712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:19.862533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:19.867177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f68ea4-90c0-4850-993d-1ccd511a2ff7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:19.926367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:19.927219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:19.927500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:19.927776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] PATH_INFO: `/v3/projects/cf3eed4e5f754419ba18f2fec4fb9734` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:19.928986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3eed4e5f754419ba18f2fec4fb9734)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:19.930900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:19.942243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:20.105536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3eed4e5f754419ba18f2fec4fb9734', 'request_id': 'req-cb4b16bb-5263-4767-bd47-5b705dccea25'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:20.200522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3eed4e5f754419ba18f2fec4fb9734', 'request_id': 'req-cb4b16bb-5263-4767-bd47-5b705dccea25'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:20.206996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3eed4e5f754419ba18f2fec4fb9734', 'request_id': 'req-cb4b16bb-5263-4767-bd47-5b705dccea25'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:20.218637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] The token cache is being invalidate because project cf3eed4e5f754419ba18f2fec4fb9734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:20.218637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:20.219269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cb4b16bb-5263-4767-bd47-5b705dccea25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:20.220834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1169/2334] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:19 2022] DELETE /identity/v3/projects/cf3eed4e5f754419ba18f2fec4fb9734 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:20.225817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4be5a-3385-4dd9-abe3-1c6c3e3519be None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.226286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4be5a-3385-4dd9-abe3-1c6c3e3519be None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.226387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4be5a-3385-4dd9-abe3-1c6c3e3519be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.244762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e8b4be5a-3385-4dd9-abe3-1c6c3e3519be None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:20.246700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e8b4be5a-3385-4dd9-abe3-1c6c3e3519be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:20.305783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1166/2335] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:20.314014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6866-0817-4254-9673-28f5fa6f0254 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.314301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6866-0817-4254-9673-28f5fa6f0254 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.314603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6866-0817-4254-9673-28f5fa6f0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.333395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1e3a6866-0817-4254-9673-28f5fa6f0254 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:20.334589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1e3a6866-0817-4254-9673-28f5fa6f0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:20.342860 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1170/2336] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:20.347077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4be5a-3385-4dd9-abe3-1c6c3e3519be None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:20.356970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4be5a-3385-4dd9-abe3-1c6c3e3519be None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:20.361577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:20.362224 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.362506 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.362783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.363505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:25:20.363813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:20.365475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:20.377662 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1167/2337] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:25:20.382056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6866-0817-4254-9673-28f5fa6f0254 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:20.391937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6866-0817-4254-9673-28f5fa6f0254 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:20.396641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:20.397278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.397560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.397836 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.398516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:20.400451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:20.500861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1171/2338] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:20 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:20.504996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:20.515221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7d296-6240-4be4-96b7-5d423d985db8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:20.534115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:20.572424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:20.573106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.573396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.573699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.574405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:20.576418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:20.710404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1168/2339] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:20 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:20.714603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:20.724873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a273c-a7c0-44b1-9d0b-79cea5ea95bf admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:20.729417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:20.730590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.730872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.731147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.731887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:20.733504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:20.743872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1172/2340] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:20.748548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:20.758428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3a6f-1e68-4850-8469-c738d0cebf00 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:20.763500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe1ce2-c40a-4e18-8bf9-20f517436639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:20.764166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe1ce2-c40a-4e18-8bf9-20f517436639 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.764482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe1ce2-c40a-4e18-8bf9-20f517436639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.764755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe1ce2-c40a-4e18-8bf9-20f517436639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.765471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe1ce2-c40a-4e18-8bf9-20f517436639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:20.767047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe1ce2-c40a-4e18-8bf9-20f517436639 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:20.777523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1169/2341] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:20.781278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:20.790985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ca84a-49cd-46d1-9979-06a0e8fa1ba8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:20.796123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:20.797005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.797286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.797560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] PATH_INFO: `/v3/projects/76673d2e823a40e7ad476ae3d8c3ad7c/users/8076a3ebc0de43b98d9e296a40b69bd8/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.811938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76673d2e823a40e7ad476ae3d8c3ad7c, user_id=8076a3ebc0de43b98d9e296a40b69bd8, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:20.814619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:20.881605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1173/2342] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:20 2022] PUT /identity/v3/projects/76673d2e823a40e7ad476ae3d8c3ad7c/users/8076a3ebc0de43b98d9e296a40b69bd8/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:20.893264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e84f6-50fb-4694-904e-8a5eec8b955a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:20.893775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e84f6-50fb-4694-904e-8a5eec8b955a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:20.894236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e84f6-50fb-4694-904e-8a5eec8b955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:20.925320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9e4e84f6-50fb-4694-904e-8a5eec8b955a None None] MFA Rules not processed for user `8076a3ebc0de43b98d9e296a40b69bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:20.926682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9e4e84f6-50fb-4694-904e-8a5eec8b955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:20.994744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1170/2343] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:20.999305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.064038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e05eb-06e1-4d09-b043-03a12060c691 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.069079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.069733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.072042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.072042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.072042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.073089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.187716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1174/2344] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:20 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:21.190382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e84f6-50fb-4694-904e-8a5eec8b955a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.202323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e84f6-50fb-4694-904e-8a5eec8b955a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.258016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.258652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.258870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.259151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.259857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.262340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.379500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1171/2345] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:21 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:21.383246 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.393973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd75e5-722c-4bd7-9906-cda2576a6b58 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.398540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.399188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.399472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.399757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.400518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.402845 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.413337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1175/2346] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:21.417392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.427675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bb5ab-a551-4816-9ba9-c032a75b1481 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.432366 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.433616 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.434077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.434381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] PATH_INFO: `/v3/projects/f86e1fa2693048baa5ae93b75d36cfb1/users/428aca7335e9436da0532a24e009936e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.449845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86e1fa2693048baa5ae93b75d36cfb1, user_id=428aca7335e9436da0532a24e009936e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.452727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.455675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:21.528145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1172/2347] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:21 2022] PUT /identity/v3/projects/f86e1fa2693048baa5ae93b75d36cfb1/users/428aca7335e9436da0532a24e009936e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:21.532051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.542042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256222-4a25-4d08-8c2a-9325d1541293 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.550118 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:21.599199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51de2-aed3-42bb-be6e-9a9f74cc2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.599862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51de2-aed3-42bb-be6e-9a9f74cc2a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.600149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51de2-aed3-42bb-be6e-9a9f74cc2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.600484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51de2-aed3-42bb-be6e-9a9f74cc2a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.601208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51de2-aed3-42bb-be6e-9a9f74cc2a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.602804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51de2-aed3-42bb-be6e-9a9f74cc2a3b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.612628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1176/2348] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:21.616861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.627954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927257ac-03de-45e1-a1d0-2b7bbfadf94e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.632579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.633552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.633860 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.634134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] PATH_INFO: `/v3/projects/f86e1fa2693048baa5ae93b75d36cfb1/users/428aca7335e9436da0532a24e009936e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.637234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86e1fa2693048baa5ae93b75d36cfb1, user_id=428aca7335e9436da0532a24e009936e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.639483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.649564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1173/2349] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:21 2022] PUT /identity/v3/projects/f86e1fa2693048baa5ae93b75d36cfb1/users/428aca7335e9436da0532a24e009936e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:21.659547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.659840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.660120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.687717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] MFA Rules not processed for user `428aca7335e9436da0532a24e009936e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:21.689042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:21.758699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1177/2350] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:21.770041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.771738 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:21.833569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaafa3-13c4-4d79-8c36-6aae276f4ffa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.837204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.837846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.838130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.838410 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.847510 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.851490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.858623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1174/2351] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:21.907006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:21.908542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:21.921235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca5691-ce3a-42a5-9422-72e09ac08cc4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:21.924844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43023ada-f7d8-47b2-a96a-2412c73bc6e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:21.925480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023ada-f7d8-47b2-a96a-2412c73bc6e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:21.925759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023ada-f7d8-47b2-a96a-2412c73bc6e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:21.926036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023ada-f7d8-47b2-a96a-2412c73bc6e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:21.983564 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43023ada-f7d8-47b2-a96a-2412c73bc6e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:21.985031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43023ada-f7d8-47b2-a96a-2412c73bc6e9 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:21.994008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1178/2352] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:26.810161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:26.872138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b82e6-a47a-41b3-afb7-96c7b36fb902 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:26.876785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:26.877657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:26.877925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:26.878201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] PATH_INFO: `/v3/users/8076a3ebc0de43b98d9e296a40b69bd8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:26.879395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8076a3ebc0de43b98d9e296a40b69bd8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:26.881362 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:27.060584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8076a3ebc0de43b98d9e296a40b69bd8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:27.072599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8076a3ebc0de43b98d9e296a40b69bd8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:27.079734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8076a3ebc0de43b98d9e296a40b69bd8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:27.080434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8076a3ebc0de43b98d9e296a40b69bd8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:27.155778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8076a3ebc0de43b98d9e296a40b69bd8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:27.161879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1175/2353] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:26 2022] DELETE /identity/v3/users/8076a3ebc0de43b98d9e296a40b69bd8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:27.166326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:27.166835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:27.166935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:27.183844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:27.185076 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:27.210942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:27.243943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1179/2354] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:27.253452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:27.254845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:27.261358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:27.313379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5937d7-515f-4bfe-89ca-81619f3688af admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:27.317142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:27.317777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:27.318060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:27.318332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:27.327798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:27.329255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:27.339329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1176/2355] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:27.780631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:27.782244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:27.796584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac41b-d92e-4d83-b5c5-ba4d69bdaf35 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:27.801592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:27.802445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:27.802722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:27.802995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] PATH_INFO: `/v3/projects/76673d2e823a40e7ad476ae3d8c3ad7c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:27.804757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76673d2e823a40e7ad476ae3d8c3ad7c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:27.811795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:27.970321 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76673d2e823a40e7ad476ae3d8c3ad7c', 'request_id': 'req-dd4f669d-f810-4b9b-8e51-3a56e179fc67'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.080300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76673d2e823a40e7ad476ae3d8c3ad7c', 'request_id': 'req-dd4f669d-f810-4b9b-8e51-3a56e179fc67'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.088019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76673d2e823a40e7ad476ae3d8c3ad7c', 'request_id': 'req-dd4f669d-f810-4b9b-8e51-3a56e179fc67'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.100534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] The token cache is being invalidate because project 76673d2e823a40e7ad476ae3d8c3ad7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:28.100822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.101501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.103068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1180/2356] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:27 2022] DELETE /identity/v3/projects/76673d2e823a40e7ad476ae3d8c3ad7c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:28.107154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:28.116709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6f6b-3773-43b1-9920-ef52d8b2c978 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:28.174047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:28.174906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:28.175183 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:28.175459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] PATH_INFO: `/v3/users/428aca7335e9436da0532a24e009936e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:28.176733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] RBAC: Authorizing `identity:delete_user(user_id=428aca7335e9436da0532a24e009936e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:28.178653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:28.392115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428aca7335e9436da0532a24e009936e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.405078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428aca7335e9436da0532a24e009936e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.413173 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428aca7335e9436da0532a24e009936e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.413970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428aca7335e9436da0532a24e009936e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.487482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-76fdbaab-b607-4eb1-9ac1-ff2c37ae57df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428aca7335e9436da0532a24e009936e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:28.499389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1177/2357] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:28 2022] DELETE /identity/v3/users/428aca7335e9436da0532a24e009936e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:28.881186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:28.884433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:28.898137 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f669d-f810-4b9b-8e51-3a56e179fc67 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:28.957603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:28.958449 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:28.958726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:28.958998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] PATH_INFO: `/v3/projects/f86e1fa2693048baa5ae93b75d36cfb1` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:28.960173 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86e1fa2693048baa5ae93b75d36cfb1)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:28.962093 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:29.067360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86e1fa2693048baa5ae93b75d36cfb1', 'request_id': 'req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:29.141962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86e1fa2693048baa5ae93b75d36cfb1', 'request_id': 'req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:29.143095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:29.148834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86e1fa2693048baa5ae93b75d36cfb1', 'request_id': 'req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:29.159313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] The token cache is being invalidate because project f86e1fa2693048baa5ae93b75d36cfb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:29.159595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:29.160252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d66ef7c7-25da-4a05-b5f0-4f9c9b3bc371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:29.161791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1181/2358] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:28 2022] DELETE /identity/v3/projects/f86e1fa2693048baa5ae93b75d36cfb1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:29.166688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3dbd8-9060-4b9e-bb4e-6641c9cefebc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.167169 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3dbd8-9060-4b9e-bb4e-6641c9cefebc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.167296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3dbd8-9060-4b9e-bb4e-6641c9cefebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.186640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-01f3dbd8-9060-4b9e-bb4e-6641c9cefebc None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:29.187839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01f3dbd8-9060-4b9e-bb4e-6641c9cefebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:29.208820 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:29.249107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1178/2359] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:29.256612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fe6d-2d31-490b-bb12-dd1be79fffbe None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.256902 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fe6d-2d31-490b-bb12-dd1be79fffbe None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.257180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fe6d-2d31-490b-bb12-dd1be79fffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.275493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b528fe6d-2d31-490b-bb12-dd1be79fffbe None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:29.276728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b528fe6d-2d31-490b-bb12-dd1be79fffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:29.285375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1182/2360] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:29.289833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3dbd8-9060-4b9e-bb4e-6641c9cefebc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:29.301010 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3dbd8-9060-4b9e-bb4e-6641c9cefebc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:29.305593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:29.306237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.308639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.308639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.308639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:25:29.308639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:29.309638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:29.321459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1179/2361] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:25:29.325542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528fe6d-2d31-490b-bb12-dd1be79fffbe None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:29.335165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528fe6d-2d31-490b-bb12-dd1be79fffbe None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:29.339991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:29.340713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.340997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.341819 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.342591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:29.344614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:29.420417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1183/2362] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:29 2022] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:29.424589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:29.434977 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792321d8-7457-44c6-b813-5ee24ccf043e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:29.504915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:29.505655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.505872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.509211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.509211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:29.509211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:29.620603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1180/2363] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:29 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:29.625561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:29.635774 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313855-adc9-437d-9ee7-3f14e58d2ac1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:29.645232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:29.645901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.646238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.646458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.647178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:29.648809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:29.660483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1184/2364] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:29.664563 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:29.675379 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6071d-ee03-4498-a2a5-9740ee7c7746 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:29.680223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8542f2-4b71-4737-bb8f-4a49f5b3f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:29.680884 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8542f2-4b71-4737-bb8f-4a49f5b3f286 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.681171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8542f2-4b71-4737-bb8f-4a49f5b3f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.681453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8542f2-4b71-4737-bb8f-4a49f5b3f286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.682203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8542f2-4b71-4737-bb8f-4a49f5b3f286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:29.684059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8542f2-4b71-4737-bb8f-4a49f5b3f286 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:29.694707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1181/2365] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:29.698660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:29.709244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259be90-fe0f-45b8-a06f-9ab0edc6a76d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:29.713722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:29.714580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.714858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.715134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] PATH_INFO: `/v3/projects/f201fa4b62c8413b979725bd91f474cb/users/e68d8c6837674ae9a254996e25ca70a5/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.730040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f201fa4b62c8413b979725bd91f474cb, user_id=e68d8c6837674ae9a254996e25ca70a5, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:29.732875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:29.811723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1185/2366] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:29 2022] PUT /identity/v3/projects/f201fa4b62c8413b979725bd91f474cb/users/e68d8c6837674ae9a254996e25ca70a5/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:29.822774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fdc86-98df-4886-af23-6a1665cda9c9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.823067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fdc86-98df-4886-af23-6a1665cda9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.823416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fdc86-98df-4886-af23-6a1665cda9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.850867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e09fdc86-98df-4886-af23-6a1665cda9c9 None None] MFA Rules not processed for user `e68d8c6837674ae9a254996e25ca70a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:29.852034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e09fdc86-98df-4886-af23-6a1665cda9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:29.914872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1182/2367] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:29.919367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:29.983683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c876fd-dfab-4fce-b842-df61c539dfc9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:29.988325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:29.988973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:29.989251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:29.989524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:29.990208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:29.992133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:30.094703 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1186/2368] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:29 2022] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:25:30.098875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fdc86-98df-4886-af23-6a1665cda9c9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:30.110303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fdc86-98df-4886-af23-6a1665cda9c9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:30.128787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:30.165813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:30.166475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:30.166762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:30.167340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:30.167743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:30.170390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:30.277226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1183/2369] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:30 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:30.280552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:30.290756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73775-3f14-4f52-9b53-b7db423ebe46 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:30.296275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:30.296916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:30.297197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:30.297473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:30.298194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:30.299771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:30.311778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1187/2370] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:30.315991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:30.326302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396694b4-5905-4e70-801c-4f9815ef3178 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:30.331157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:30.332032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:30.332354 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:30.332633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] PATH_INFO: `/v3/projects/68d524755b24476b81760da2b214df39/users/d3229ffd4867464c9989a5912bd6b4d7/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:30.347812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d524755b24476b81760da2b214df39, user_id=d3229ffd4867464c9989a5912bd6b4d7, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:30.350505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:30.416781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1184/2371] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:30 2022] PUT /identity/v3/projects/68d524755b24476b81760da2b214df39/users/d3229ffd4867464c9989a5912bd6b4d7/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:30.421542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:30.431601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746396fd-bb83-4500-b661-b03869ce9bd6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:30.482642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:30.489358 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2a133-7e65-4cde-b5c3-7e3fe4e32b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:30.490045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a133-7e65-4cde-b5c3-7e3fe4e32b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:30.490325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a133-7e65-4cde-b5c3-7e3fe4e32b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:30.490598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a133-7e65-4cde-b5c3-7e3fe4e32b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:30.491351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2a133-7e65-4cde-b5c3-7e3fe4e32b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:30.492987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2a133-7e65-4cde-b5c3-7e3fe4e32b3e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:30.503195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1188/2372] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:30.514698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:30.525528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd6be-4cb9-47f3-9d6e-60807905bcb3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:30.530731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:30.531606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:30.531926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:30.532280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] PATH_INFO: `/v3/projects/68d524755b24476b81760da2b214df39/users/d3229ffd4867464c9989a5912bd6b4d7/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:30.534342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d524755b24476b81760da2b214df39, user_id=d3229ffd4867464c9989a5912bd6b4d7, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:30.537270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:30.548722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1185/2373] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:30 2022] PUT /identity/v3/projects/68d524755b24476b81760da2b214df39/users/d3229ffd4867464c9989a5912bd6b4d7/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:30.559039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:30.559332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:30.559614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:30.588612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] MFA Rules not processed for user `d3229ffd4867464c9989a5912bd6b4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:30.589823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:30.668946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1189/2374] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:30.687031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:30.688886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:30.750869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335734-8ace-4935-a0ee-98a6e8e2895d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:30.755022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:30.755674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:30.757593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:30.757593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:30.767656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:30.769270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:30.779139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1186/2375] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:31.038004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:31.039617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:31.052083 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4748b1-e9d0-4479-a7fc-93fa49c32369 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:31.055641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b86d0f-2a62-4f76-b2f9-30486e3d08d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:31.056313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b86d0f-2a62-4f76-b2f9-30486e3d08d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:31.056596 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b86d0f-2a62-4f76-b2f9-30486e3d08d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:31.056870 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b86d0f-2a62-4f76-b2f9-30486e3d08d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:31.114481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b86d0f-2a62-4f76-b2f9-30486e3d08d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:31.116284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b86d0f-2a62-4f76-b2f9-30486e3d08d6 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:31.127370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1190/2376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:36.342781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:36.405575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92dd39-ba75-4e0c-8fed-5ea2a03eccd5 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:36.410334 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:36.411143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:36.411423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:36.411697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] PATH_INFO: `/v3/users/e68d8c6837674ae9a254996e25ca70a5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:36.412912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68d8c6837674ae9a254996e25ca70a5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:36.414846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:36.438134 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:36.708526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68d8c6837674ae9a254996e25ca70a5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:36.725110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68d8c6837674ae9a254996e25ca70a5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:36.735007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68d8c6837674ae9a254996e25ca70a5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:36.735953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68d8c6837674ae9a254996e25ca70a5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:36.828737 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68d8c6837674ae9a254996e25ca70a5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:36.835532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1187/2377] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:36 2022] DELETE /identity/v3/users/e68d8c6837674ae9a254996e25ca70a5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:36.840021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:36.840561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:36.840661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:36.858675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:36.859921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:36.945087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1191/2378] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:36.955229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:36.956754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:37.024454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c83181-9cbe-4a8d-af4a-e7fa6a553a91 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:37.028508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:37.029610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:37.031255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:37.032792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:37.045965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:37.047492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:37.058046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1188/2379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:37.532497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:37.535766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:37.551421 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae842d74-35a7-4041-88f7-eb1eb39ee472 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:37.557191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:37.558125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:37.558574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:37.558850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] PATH_INFO: `/v3/projects/f201fa4b62c8413b979725bd91f474cb` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:37.561186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f201fa4b62c8413b979725bd91f474cb)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:37.562752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:37.574731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:37.709139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f201fa4b62c8413b979725bd91f474cb', 'request_id': 'req-d2a937d7-6d51-4e22-ba09-fa082fe8812e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:37.788024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f201fa4b62c8413b979725bd91f474cb', 'request_id': 'req-d2a937d7-6d51-4e22-ba09-fa082fe8812e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:37.796160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f201fa4b62c8413b979725bd91f474cb', 'request_id': 'req-d2a937d7-6d51-4e22-ba09-fa082fe8812e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:37.806694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] The token cache is being invalidate because project f201fa4b62c8413b979725bd91f474cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:37.806983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:37.807627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:37.809576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1192/2380] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:37 2022] DELETE /identity/v3/projects/f201fa4b62c8413b979725bd91f474cb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:37.814577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:37.824175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9c37-3da9-4219-9571-d6fc5fcc6f25 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:37.881651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:37.882502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:37.882780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:37.883055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] PATH_INFO: `/v3/users/d3229ffd4867464c9989a5912bd6b4d7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:37.884240 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3229ffd4867464c9989a5912bd6b4d7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:37.886177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:38.151068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:38.156625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3229ffd4867464c9989a5912bd6b4d7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.168284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3229ffd4867464c9989a5912bd6b4d7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.175788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3229ffd4867464c9989a5912bd6b4d7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.176483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3229ffd4867464c9989a5912bd6b4d7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.227668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3192c7f6-1168-403e-aaf8-057986b5732c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3229ffd4867464c9989a5912bd6b4d7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.234367 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1189/2381] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:37 2022] DELETE /identity/v3/users/d3229ffd4867464c9989a5912bd6b4d7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:38.654621 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:38.656059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:38.670462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a937d7-6d51-4e22-ba09-fa082fe8812e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:38.727892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:38.728788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:38.729075 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:38.729344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] PATH_INFO: `/v3/projects/68d524755b24476b81760da2b214df39` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:38.730501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d524755b24476b81760da2b214df39)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:38.733122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:38.842854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d524755b24476b81760da2b214df39', 'request_id': 'req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.916001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d524755b24476b81760da2b214df39', 'request_id': 'req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.923298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d524755b24476b81760da2b214df39', 'request_id': 'req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.934227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] The token cache is being invalidate because project 68d524755b24476b81760da2b214df39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:38.934760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.935828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ab4b60ed-99e9-49d7-96cd-e6e5e5c20418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:38.937407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1193/2382] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:38 2022] DELETE /identity/v3/projects/68d524755b24476b81760da2b214df39 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:38.942228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6deb-41cf-4020-b613-4463a3c19343 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:38.942685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6deb-41cf-4020-b613-4463a3c19343 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:38.942818 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6deb-41cf-4020-b613-4463a3c19343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:38.971232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ac7b6deb-41cf-4020-b613-4463a3c19343 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:38.972492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ac7b6deb-41cf-4020-b613-4463a3c19343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:39.100024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1190/2383] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:39.108767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f291f-5056-440a-bf06-40e87766362d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.109055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f291f-5056-440a-bf06-40e87766362d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.109335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f291f-5056-440a-bf06-40e87766362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.127306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b95f291f-5056-440a-bf06-40e87766362d None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:39.128625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b95f291f-5056-440a-bf06-40e87766362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:39.136497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1194/2384] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:39.141468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6deb-41cf-4020-b613-4463a3c19343 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:39.151037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6deb-41cf-4020-b613-4463a3c19343 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:39.156393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:39.157033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.157315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.157591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.158310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:25:39.158616 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:39.160237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:39.171935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1191/2385] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:25:39.175977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f291f-5056-440a-bf06-40e87766362d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:39.185686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f291f-5056-440a-bf06-40e87766362d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:39.190392 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:39.191028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.191311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.191587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.192302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:39.194199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:39.294685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:39.301115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1195/2386] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:39 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:39.305388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:39.316682 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66c71-771d-488c-80e1-45a8e8a257c4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:39.378494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:39.379316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.379677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.379952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.384728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:39.384728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:39.563374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:39.563666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1192/2387] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:39 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:39.579935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242e148-6137-4caf-8403-88cd60fdaffe admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:39.591592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:39.591592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.591592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.591592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.592682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:39.594328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:39.608584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1196/2388] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:39.612452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:39.629799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3ab9-14a7-47ba-a5be-6db3be9e5682 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:39.640942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362b7f2-426a-4df7-9ecb-49e13adc161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:39.641919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b7f2-426a-4df7-9ecb-49e13adc161c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.642748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b7f2-426a-4df7-9ecb-49e13adc161c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.643191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b7f2-426a-4df7-9ecb-49e13adc161c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.644151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362b7f2-426a-4df7-9ecb-49e13adc161c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:39.646760 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362b7f2-426a-4df7-9ecb-49e13adc161c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:39.661451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1193/2389] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:39.667364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:39.684469 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc64c4c-ff04-483c-a0b9-657b0d34c194 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:39.690149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:39.691031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.691305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.691608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] PATH_INFO: `/v3/projects/4c6034099f18497b9fd90bbcea4be0d1/users/2499c855497b4ed6bc372062b91686e2/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.720109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6034099f18497b9fd90bbcea4be0d1, user_id=2499c855497b4ed6bc372062b91686e2, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:39.723287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:39.899434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1197/2390] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:39 2022] PUT /identity/v3/projects/4c6034099f18497b9fd90bbcea4be0d1/users/2499c855497b4ed6bc372062b91686e2/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:39.912189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4984d-6df2-4ba5-94b9-d0583b3def91 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:39.912558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4984d-6df2-4ba5-94b9-d0583b3def91 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:39.912844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4984d-6df2-4ba5-94b9-d0583b3def91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:39.941072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c8c4984d-6df2-4ba5-94b9-d0583b3def91 None None] MFA Rules not processed for user `2499c855497b4ed6bc372062b91686e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:39.948443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c8c4984d-6df2-4ba5-94b9-d0583b3def91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:39.955515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:40.012105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1194/2391] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:40.017639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:40.091485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9714cb-e42f-4773-b0e3-98c7affc5525 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:40.098948 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:40.099613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:40.099895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:40.101225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:40.101225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:40.102785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:40.321302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1198/2392] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:40 2022] POST /identity/v3/projects => generated 379 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:40.322671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4984d-6df2-4ba5-94b9-d0583b3def91 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:40.334403 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4984d-6df2-4ba5-94b9-d0583b3def91 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:40.401504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:40.402184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:40.402914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:40.403192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:40.404979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:40.407378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:40.626650 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1195/2393] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:40 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:40.630714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:40.642177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11deae89-57a4-4c3a-b35f-93e8d376a48c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:40.652000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:40.652000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:40.652000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:40.652000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:40.652525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:40.652525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:40.663830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1199/2394] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:40.668693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:40.683768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51010dcc-dc7a-4852-ae8d-0a23393afecd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:40.693016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:40.693967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:40.694248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:40.694582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] PATH_INFO: `/v3/projects/2c937fef93ef4acc8775b32d014e81f5/users/57d3e513b61346cda29027bbb0cca2fe/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:40.719405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c937fef93ef4acc8775b32d014e81f5, user_id=57d3e513b61346cda29027bbb0cca2fe, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:40.726639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:40.834991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1196/2395] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:40 2022] PUT /identity/v3/projects/2c937fef93ef4acc8775b32d014e81f5/users/57d3e513b61346cda29027bbb0cca2fe/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:40.838587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:40.849591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8edaff-cbd3-49d8-af30-f21970c9b03f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:40.927645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5e0e2-b1b9-4830-96a9-8a294dcb4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:40.927645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e0e2-b1b9-4830-96a9-8a294dcb4c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:40.927645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e0e2-b1b9-4830-96a9-8a294dcb4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:40.927645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e0e2-b1b9-4830-96a9-8a294dcb4c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:40.928069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5e0e2-b1b9-4830-96a9-8a294dcb4c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:40.929360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5e0e2-b1b9-4830-96a9-8a294dcb4c9e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:40.942822 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1200/2396] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:40.954494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:40.967489 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f10c6-5d2d-4713-bad2-e35e103457df admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:40.971829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:40.972864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:40.977516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:40.977976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] PATH_INFO: `/v3/projects/2c937fef93ef4acc8775b32d014e81f5/users/57d3e513b61346cda29027bbb0cca2fe/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:40.981915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c937fef93ef4acc8775b32d014e81f5, user_id=57d3e513b61346cda29027bbb0cca2fe, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:40.983548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:40.996997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1197/2397] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:40 2022] PUT /identity/v3/projects/2c937fef93ef4acc8775b32d014e81f5/users/57d3e513b61346cda29027bbb0cca2fe/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:41.008021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1379f3-56eb-4ea4-8c8d-863912375ca1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:41.008406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1379f3-56eb-4ea4-8c8d-863912375ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:41.008642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1379f3-56eb-4ea4-8c8d-863912375ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:41.037450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2a1379f3-56eb-4ea4-8c8d-863912375ca1 None None] MFA Rules not processed for user `57d3e513b61346cda29027bbb0cca2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:41.038701 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a1379f3-56eb-4ea4-8c8d-863912375ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:41.068369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:41.128884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1201/2398] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:41.146047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:41.146047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:41.212675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8066-f096-4a07-b398-be70ef681bfb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:41.217481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:41.218133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:41.218415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:41.218687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:41.229311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:41.232513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:41.245814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1198/2399] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:41.414876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1379f3-56eb-4ea4-8c8d-863912375ca1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:41.432147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1379f3-56eb-4ea4-8c8d-863912375ca1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:41.437855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485375f-de8f-4465-8839-0c9e3ef3babe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:41.438673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485375f-de8f-4465-8839-0c9e3ef3babe service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:41.439023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485375f-de8f-4465-8839-0c9e3ef3babe service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:41.439397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485375f-de8f-4465-8839-0c9e3ef3babe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:41.529011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485375f-de8f-4465-8839-0c9e3ef3babe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:41.531630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485375f-de8f-4465-8839-0c9e3ef3babe service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:41.546247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1202/2400] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:42.136009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:42.146504 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:42.203729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab29fc-33cd-4c55-ac35-5d88e63b752f service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:42.208854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:42.209758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:42.210022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:42.217034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] PATH_INFO: `/v3/users/2499c855497b4ed6bc372062b91686e2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:42.217034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2499c855497b4ed6bc372062b91686e2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:42.217034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:42.425541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2499c855497b4ed6bc372062b91686e2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:42.439794 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2499c855497b4ed6bc372062b91686e2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:42.448110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2499c855497b4ed6bc372062b91686e2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:42.453363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2499c855497b4ed6bc372062b91686e2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:42.531566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2499c855497b4ed6bc372062b91686e2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:42.538800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1199/2401] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:42 2022] DELETE /identity/v3/users/2499c855497b4ed6bc372062b91686e2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:42.543571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:42.545293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:42.545293 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:42.562370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:42.563597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:42.631270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1203/2402] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:42.641203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:42.642708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:42.705230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969c0f7-de17-4d37-8608-acae5cbee442 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:42.709199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:42.711497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:42.711497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:42.711497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:42.720544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:42.721971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:42.732328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1200/2403] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:25:43.235121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:43.236616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:43.249573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43459c-51bb-434f-b27a-3857c047a955 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:43.254465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:43.255348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:43.255628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:43.255905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] PATH_INFO: `/v3/projects/4c6034099f18497b9fd90bbcea4be0d1` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:43.257243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6034099f18497b9fd90bbcea4be0d1)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:43.259166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:43.381180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6034099f18497b9fd90bbcea4be0d1', 'request_id': 'req-361e97cf-21e7-4f04-91c8-211a99424a8c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.385417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:43.493619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6034099f18497b9fd90bbcea4be0d1', 'request_id': 'req-361e97cf-21e7-4f04-91c8-211a99424a8c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.501652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6034099f18497b9fd90bbcea4be0d1', 'request_id': 'req-361e97cf-21e7-4f04-91c8-211a99424a8c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.512333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] The token cache is being invalidate because project 4c6034099f18497b9fd90bbcea4be0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:43.512630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.514189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.515749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1204/2404] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:43 2022] DELETE /identity/v3/projects/4c6034099f18497b9fd90bbcea4be0d1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:43.519801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:43.529867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837c7d-4af1-485a-8c38-e97707423e03 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:43.559084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:43.589787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:43.590648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:43.590929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:43.591200 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] PATH_INFO: `/v3/users/57d3e513b61346cda29027bbb0cca2fe` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:43.592421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d3e513b61346cda29027bbb0cca2fe)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:43.594337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:43.792843 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d3e513b61346cda29027bbb0cca2fe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.805030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d3e513b61346cda29027bbb0cca2fe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.813140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d3e513b61346cda29027bbb0cca2fe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.813872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d3e513b61346cda29027bbb0cca2fe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.932894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b362d16c-434f-4256-823a-53ca1fb0d249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d3e513b61346cda29027bbb0cca2fe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:43.940817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1201/2405] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:43 2022] DELETE /identity/v3/users/57d3e513b61346cda29027bbb0cca2fe => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:44.401691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:44.404405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:44.419468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e97cf-21e7-4f04-91c8-211a99424a8c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:44.495294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:44.496147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:44.496452 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:44.496722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] PATH_INFO: `/v3/projects/2c937fef93ef4acc8775b32d014e81f5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:44.497942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c937fef93ef4acc8775b32d014e81f5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:44.500583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:44.667255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c937fef93ef4acc8775b32d014e81f5', 'request_id': 'req-b562aabb-bd78-4512-9da7-55deff8161ef'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:44.758014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c937fef93ef4acc8775b32d014e81f5', 'request_id': 'req-b562aabb-bd78-4512-9da7-55deff8161ef'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:44.763089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c937fef93ef4acc8775b32d014e81f5', 'request_id': 'req-b562aabb-bd78-4512-9da7-55deff8161ef'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:44.775061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] The token cache is being invalidate because project 2c937fef93ef4acc8775b32d014e81f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:44.775343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:44.775983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b562aabb-bd78-4512-9da7-55deff8161ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:44.777848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1205/2406] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:44 2022] DELETE /identity/v3/projects/2c937fef93ef4acc8775b32d014e81f5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:44.783657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e280b-f8be-4a37-8436-d45085d18275 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:44.786953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e280b-f8be-4a37-8436-d45085d18275 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:44.786953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e280b-f8be-4a37-8436-d45085d18275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:44.802994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-de1e280b-f8be-4a37-8436-d45085d18275 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:44.804324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-de1e280b-f8be-4a37-8436-d45085d18275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:44.865087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1202/2407] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:44.927311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b040fd-e8a3-4180-80c2-b1e4d0bef192 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:44.927532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b040fd-e8a3-4180-80c2-b1e4d0bef192 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:44.927787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b040fd-e8a3-4180-80c2-b1e4d0bef192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:44.961740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e6b040fd-e8a3-4180-80c2-b1e4d0bef192 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:44.963040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e6b040fd-e8a3-4180-80c2-b1e4d0bef192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:44.974583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1206/2408] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:44.979096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e280b-f8be-4a37-8436-d45085d18275 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:44.991064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e280b-f8be-4a37-8436-d45085d18275 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:44.996419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:44.997389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:44.997871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:44.998358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:44.999841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:25:45.000324 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.001972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:45.013938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1203/2409] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:25:45.026369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b040fd-e8a3-4180-80c2-b1e4d0bef192 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:45.036484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b040fd-e8a3-4180-80c2-b1e4d0bef192 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:45.041336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:45.041977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.042256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.042526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.043236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.045194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:45.187328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1207/2410] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:45 2022] POST /identity/v3/projects => generated 359 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:45.190963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:45.200929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3bbc-cd7a-4e6c-babf-8b9db3f90785 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:45.234932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:45.259203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:45.259863 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.260145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.260451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.261133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.263060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:45.402088 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1204/2411] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:45 2022] POST /identity/v3/users => generated 280 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:45.406343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:45.417523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f37f6-b137-46c2-a551-23721eee11b5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:45.422709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:45.423367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.423705 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.423980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.424745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.426465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:45.438095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1208/2412] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:45.442402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:45.453242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce966e67-0b91-4d87-bbf6-422372cc4ddd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:45.458652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e79078-e15e-4325-9b8f-a8a3a2d23e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:45.459343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79078-e15e-4325-9b8f-a8a3a2d23e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.459623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79078-e15e-4325-9b8f-a8a3a2d23e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.459893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79078-e15e-4325-9b8f-a8a3a2d23e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.460674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e79078-e15e-4325-9b8f-a8a3a2d23e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.462288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e79078-e15e-4325-9b8f-a8a3a2d23e4e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:45.475854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1205/2413] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:45.481031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:45.492404 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b88f-b4eb-49d7-8c4d-5598dd69c5a9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:45.497169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:45.498029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.498304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.498766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] PATH_INFO: `/v3/projects/ad9c5dec8f3f4c63a54b44a8721bf3f8/users/6574d4c749c842e6a830890215c04e3e/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.514818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9c5dec8f3f4c63a54b44a8721bf3f8, user_id=6574d4c749c842e6a830890215c04e3e, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.517558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:45.641089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1209/2414] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:45 2022] PUT /identity/v3/projects/ad9c5dec8f3f4c63a54b44a8721bf3f8/users/6574d4c749c842e6a830890215c04e3e/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:45.651702 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e1dc-5faf-467e-8cfe-523d7661a022 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.651993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e1dc-5faf-467e-8cfe-523d7661a022 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.652310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e1dc-5faf-467e-8cfe-523d7661a022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.679628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a153e1dc-5faf-467e-8cfe-523d7661a022 None None] MFA Rules not processed for user `6574d4c749c842e6a830890215c04e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:45.680872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a153e1dc-5faf-467e-8cfe-523d7661a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:45.748640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1206/2415] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:45 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:45.787659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:45.789566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:45.802282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:45.856919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbb6e7-e31e-4b18-8c39-63333188bac5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:45.861085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:45.861730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.862010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.862294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.871909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.873569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:45.883568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1210/2416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:45 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:45.898658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e1dc-5faf-467e-8cfe-523d7661a022 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:45.966581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e1dc-5faf-467e-8cfe-523d7661a022 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:45.972395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:45.973275 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:45.973557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:45.973834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] PATH_INFO: `/v3/users/6574d4c749c842e6a830890215c04e3e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:45.975054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6574d4c749c842e6a830890215c04e3e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:45.978363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:46.105946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:46.107445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:46.189489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced3ab3-f448-41b9-8c9a-2f12dfddcc84 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:46.193427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b889fa-46af-45a4-8c8f-930d47772ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:46.194145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b889fa-46af-45a4-8c8f-930d47772ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:46.194372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b889fa-46af-45a4-8c8f-930d47772ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:46.194652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b889fa-46af-45a4-8c8f-930d47772ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:46.196652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-05b889fa-46af-45a4-8c8f-930d47772ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:46.210388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b889fa-46af-45a4-8c8f-930d47772ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:46.211909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b889fa-46af-45a4-8c8f-930d47772ad0 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:46.222610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1211/2417] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:25:46.237419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6574d4c749c842e6a830890215c04e3e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:46.237419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:46.250389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6574d4c749c842e6a830890215c04e3e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:46.258418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6574d4c749c842e6a830890215c04e3e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:46.263869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6574d4c749c842e6a830890215c04e3e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:46.344840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6574d4c749c842e6a830890215c04e3e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:46.351654 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1207/2418] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:45 2022] DELETE /identity/v3/users/6574d4c749c842e6a830890215c04e3e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:46.357849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369e90d-5e61-4c1e-bb4e-bd8f4fc564eb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:46.359343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369e90d-5e61-4c1e-bb4e-bd8f4fc564eb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:46.359627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369e90d-5e61-4c1e-bb4e-bd8f4fc564eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:46.380022 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2369e90d-5e61-4c1e-bb4e-bd8f4fc564eb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:46.381407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2369e90d-5e61-4c1e-bb4e-bd8f4fc564eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:46.455561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1212/2419] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:46.462424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:46.463893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:46.526967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaa71-f845-4dc9-a0ec-2d1f56a9dde3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:46.531559 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:46.532216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:46.532507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:46.532778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:46.542434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:46.543878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:46.555211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1208/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:47.183929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369e90d-5e61-4c1e-bb4e-bd8f4fc564eb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:47.195802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369e90d-5e61-4c1e-bb4e-bd8f4fc564eb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:47.200060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:47.200190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:47.202990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:47.202990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:47.205268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:47.206669 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:47.209079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:47.222251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:47.222965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf78a2e-2a00-4078-9d9a-86b8c947f61e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:47.223757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:47.228114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:47.230879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:47.230879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:47.230879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] PATH_INFO: `/v3/projects/ad9c5dec8f3f4c63a54b44a8721bf3f8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:47.233800 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9c5dec8f3f4c63a54b44a8721bf3f8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:47.235248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1213/2421] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:47.236087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:47.387294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9c5dec8f3f4c63a54b44a8721bf3f8', 'request_id': 'req-c186b8d4-d333-43b2-963a-411feab74fbd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:47.395947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9c5dec8f3f4c63a54b44a8721bf3f8', 'request_id': 'req-c186b8d4-d333-43b2-963a-411feab74fbd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:47.461971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9c5dec8f3f4c63a54b44a8721bf3f8', 'request_id': 'req-c186b8d4-d333-43b2-963a-411feab74fbd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:47.492421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] The token cache is being invalidate because project ad9c5dec8f3f4c63a54b44a8721bf3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:47.492732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:47.495162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:47.497744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1209/2422] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:47 2022] DELETE /identity/v3/projects/ad9c5dec8f3f4c63a54b44a8721bf3f8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:50.518833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:50.521828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:50.580165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:50.606543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24fb89-5799-424f-b934-79502059cdc9 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:50.702946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:50.704470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:50.717457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:50.718680 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:50.719297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:50.719913 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:50.723526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:50.743027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:50.744667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:50.758374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1214/2423] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:50.784954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:50.800635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186b8d4-d333-43b2-963a-411feab74fbd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:50.816278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:50.816278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:50.816278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:50.816278 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] PATH_INFO: `/v3/users/633cfb032a0344619f95e72492e85b9c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:50.817070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633cfb032a0344619f95e72492e85b9c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:50.817070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:51.205721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633cfb032a0344619f95e72492e85b9c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.218484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633cfb032a0344619f95e72492e85b9c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.228264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633cfb032a0344619f95e72492e85b9c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.228979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633cfb032a0344619f95e72492e85b9c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.407372 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633cfb032a0344619f95e72492e85b9c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.413821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1210/2424] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:50 2022] DELETE /identity/v3/users/633cfb032a0344619f95e72492e85b9c => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:51.461994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:51.463520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:51.478278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2480b-4a2d-4a51-94a8-312a493c464a service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:51.536733 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:51.537608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:51.537885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:51.538158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] PATH_INFO: `/v3/users/b3345cc7b11246358bb1f5babd054e60` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:51.539370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3345cc7b11246358bb1f5babd054e60)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:51.541384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:51.743453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:51.745226 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:51.760416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d9f7-6041-48dd-b3f4-516d6fb8d704 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:51.765661 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:51.766577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:51.770138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:51.770138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] PATH_INFO: `/v3/projects/a14e04756d06417da712e47759853a06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:51.770138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14e04756d06417da712e47759853a06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:51.771626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:51.799038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3345cc7b11246358bb1f5babd054e60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.807406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3345cc7b11246358bb1f5babd054e60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.807977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3345cc7b11246358bb1f5babd054e60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.808952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3345cc7b11246358bb1f5babd054e60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.821757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c90c4282-9e19-4a65-9791-febf7110c0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3345cc7b11246358bb1f5babd054e60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.824257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:51.893797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14e04756d06417da712e47759853a06', 'request_id': 'req-fd341167-b891-4b95-98ff-6da4e5bc5e4d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.899368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14e04756d06417da712e47759853a06', 'request_id': 'req-fd341167-b891-4b95-98ff-6da4e5bc5e4d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:51.910071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1215/2425] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:51 2022] DELETE /identity/v3/users/b3345cc7b11246358bb1f5babd054e60 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:52.030690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14e04756d06417da712e47759853a06', 'request_id': 'req-fd341167-b891-4b95-98ff-6da4e5bc5e4d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.042897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] The token cache is being invalidate because project a14e04756d06417da712e47759853a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:52.043396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.044018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd341167-b891-4b95-98ff-6da4e5bc5e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.046803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1211/2426] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:51 2022] DELETE /identity/v3/projects/a14e04756d06417da712e47759853a06 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:52.051871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893b7f8-2b57-4619-b4a3-5bbb9d8af62b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.056415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893b7f8-2b57-4619-b4a3-5bbb9d8af62b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.056415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893b7f8-2b57-4619-b4a3-5bbb9d8af62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.071848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9893b7f8-2b57-4619-b4a3-5bbb9d8af62b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:52.073115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9893b7f8-2b57-4619-b4a3-5bbb9d8af62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:52.131656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1216/2427] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:52.141871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.142158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.144557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.161380 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:52.162581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:52.171040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1212/2428] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:52.175630 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893b7f8-2b57-4619-b4a3-5bbb9d8af62b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.185728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893b7f8-2b57-4619-b4a3-5bbb9d8af62b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.191036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.191724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.192004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.192351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.193081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:25:52.193486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.195087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.198792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.200472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:52.209113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1217/2429] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:25:52.213127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.215086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4537e-1622-48d1-8982-97a863ad64d9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.221147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.222014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.222302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.223062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] PATH_INFO: `/v3/projects/dc30155e50104560b2cd8d95f3e534a6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.223913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc30155e50104560b2cd8d95f3e534a6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.225997 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.226844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddddf6-22fd-46c6-802b-950beb7f2924 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.231847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.232629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.233498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.233760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.234559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.236515 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.353327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1218/2430] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:52.354710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.362730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:52.369026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc30155e50104560b2cd8d95f3e534a6', 'request_id': 'req-52635694-cb0f-43a2-ae56-87f756d4fbfd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.374934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc30155e50104560b2cd8d95f3e534a6', 'request_id': 'req-52635694-cb0f-43a2-ae56-87f756d4fbfd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.416502 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14a400-640a-4d37-ace3-71a32b74a776 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.470025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc30155e50104560b2cd8d95f3e534a6', 'request_id': 'req-52635694-cb0f-43a2-ae56-87f756d4fbfd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.471927 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.472629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.472914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.473195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.473882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.475798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.481696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] The token cache is being invalidate because project dc30155e50104560b2cd8d95f3e534a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:52.481980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.482683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-52635694-cb0f-43a2-ae56-87f756d4fbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:52.484871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1213/2431] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:52 2022] DELETE /identity/v3/projects/dc30155e50104560b2cd8d95f3e534a6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:52.489548 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bf06d-8e41-409c-b4ee-fb7bd4bc6f2a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.489828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bf06d-8e41-409c-b4ee-fb7bd4bc6f2a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.490105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bf06d-8e41-409c-b4ee-fb7bd4bc6f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.507708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1f4bf06d-8e41-409c-b4ee-fb7bd4bc6f2a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:52.509005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1f4bf06d-8e41-409c-b4ee-fb7bd4bc6f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:52.516790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1214/2432] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:52.525262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e013c-d715-4fdc-9c03-6b66215b23df None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.525593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e013c-d715-4fdc-9c03-6b66215b23df None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.525867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e013c-d715-4fdc-9c03-6b66215b23df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.543466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-708e013c-d715-4fdc-9c03-6b66215b23df None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:52.544673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-708e013c-d715-4fdc-9c03-6b66215b23df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:52.553281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1215/2433] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:52.557150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e013c-d715-4fdc-9c03-6b66215b23df None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.566743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e013c-d715-4fdc-9c03-6b66215b23df None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.571709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.572407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.572687 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.572960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.573684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:25:52.573797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1219/2434] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:25:52.574214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.575571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.578556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.580930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:52.589323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1216/2435] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:25:52.594314 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.600008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a52e-397a-4c3b-b97f-7332444af328 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.602123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.602777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.603056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.603327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.604186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90fb9e-2758-4c65-b76a-1b4dbb43cca4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.604355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.605800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.609165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.609810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.610095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.610392 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.611062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.613005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.615977 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1220/2436] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:25:52.619918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.629590 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94d2d-aa27-488c-8e64-ed169a351486 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.634382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.635023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.635306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.635580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.636331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.637972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.645702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:52.651076 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1221/2437] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:25:52.655854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.665133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aa439-7c73-4c77-93a3-13184f743cae admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.669679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3574bac-06bf-4f9b-9e2b-6a80adc9faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.670838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574bac-06bf-4f9b-9e2b-6a80adc9faab admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.671124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574bac-06bf-4f9b-9e2b-6a80adc9faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.671402 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574bac-06bf-4f9b-9e2b-6a80adc9faab admin admin] PATH_INFO: `/v3/projects/63940e11d38849c7b063920d36b797ba/users/0c236d015c5e4b6ab061e78273a8af93/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.687176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3574bac-06bf-4f9b-9e2b-6a80adc9faab admin admin] RBAC: Authorizing `identity:create_grant(project_id=63940e11d38849c7b063920d36b797ba, user_id=0c236d015c5e4b6ab061e78273a8af93, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.689900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3574bac-06bf-4f9b-9e2b-6a80adc9faab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.703867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1217/2438] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:25:52.707988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.756517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1222/2439] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:52 2022] PUT /identity/v3/projects/63940e11d38849c7b063920d36b797ba/users/0c236d015c5e4b6ab061e78273a8af93/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:52.767574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1980-9745-4fec-a718-b9fd9633f8a6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.767858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1980-9745-4fec-a718-b9fd9633f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.768134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1980-9745-4fec-a718-b9fd9633f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.771318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802389c6-8dc0-41fe-a618-1279c87c1565 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.794406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3bdf1980-9745-4fec-a718-b9fd9633f8a6 None None] MFA Rules not processed for user `0c236d015c5e4b6ab061e78273a8af93`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:52.795614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3bdf1980-9745-4fec-a718-b9fd9633f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:52.829268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.829934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.830212 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.830486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.831193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.833691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.862084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1223/2440] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:52.866368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1980-9745-4fec-a718-b9fd9633f8a6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.876552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1980-9745-4fec-a718-b9fd9633f8a6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.881074 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.881691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.881966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.882237 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.882903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.884820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.927731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1218/2441] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:25:52.931425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.941793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773e2a3-d747-4077-a05f-b86a5e5fab00 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.946501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.947140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.947424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.947704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.948456 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.950037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.962398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1219/2442] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:25:52.966044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:52.975651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92bd98-6940-4aef-b581-8165b7a5d89b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:52.980359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:52.980988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:52.981273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:52.981552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:52.982261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:52.983834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:52.994185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1220/2443] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:25:52.998995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.001378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1224/2444] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:52 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:25:53.005302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.009192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015417b-9d43-4089-937a-df6e535c905b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.066724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86491e-5430-44cc-8260-ddf92401467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.066954 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75eca5-034f-4ca1-aacf-d70416c26725 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.068171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86491e-5430-44cc-8260-ddf92401467d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.068498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86491e-5430-44cc-8260-ddf92401467d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.068781 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86491e-5430-44cc-8260-ddf92401467d admin admin] PATH_INFO: `/v3/projects/1a73604375df4a07998a5cacfba82bcb/users/34a4e4ecf1a74c188cd0bb9fc6099f36/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.071812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.072512 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.072793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.073069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.073754 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.075676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.085995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86491e-5430-44cc-8260-ddf92401467d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a73604375df4a07998a5cacfba82bcb, user_id=34a4e4ecf1a74c188cd0bb9fc6099f36, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.088724 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86491e-5430-44cc-8260-ddf92401467d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.178843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1225/2445] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:53 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:25:53.182642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.192892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcec77-5632-4d02-a9f8-cacb43ad193e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.198152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.198304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:53.198805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.199081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.199355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.200069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.202797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.204692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1221/2446] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:52 2022] PUT /identity/v3/projects/1a73604375df4a07998a5cacfba82bcb/users/34a4e4ecf1a74c188cd0bb9fc6099f36/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:53.215391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43105-5273-4397-a269-d212a9caa3c4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.215675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43105-5273-4397-a269-d212a9caa3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.215961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43105-5273-4397-a269-d212a9caa3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.222274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1226/2447] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:25:53.223333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.233371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89c851-0329-44c5-869d-4c4fdde57c16 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.242208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5fa43105-5273-4397-a269-d212a9caa3c4 None None] MFA Rules not processed for user `34a4e4ecf1a74c188cd0bb9fc6099f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:53.243415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5fa43105-5273-4397-a269-d212a9caa3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:53.291393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.292301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.292584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.292858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] PATH_INFO: `/v3/projects/daede71cdc204e86a38a267727d94e82/users/10fbcca5559341408eef51f1bf72247c/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.305862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:53.307963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1222/2448] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:53.310554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daede71cdc204e86a38a267727d94e82, user_id=10fbcca5559341408eef51f1bf72247c, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.313376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa43105-5273-4397-a269-d212a9caa3c4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.314683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.323678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa43105-5273-4397-a269-d212a9caa3c4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.328730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.329361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.329645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.329922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.330607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.332521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.395853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1227/2449] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:53 2022] PUT /identity/v3/projects/daede71cdc204e86a38a267727d94e82/users/10fbcca5559341408eef51f1bf72247c/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:53.405279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.430067 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1223/2450] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:25:53 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:25:53.434076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.478334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7100f-2843-472e-8770-bcd9cdb98cc4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.496723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f92c-b84e-432c-b0a2-04cfaace407b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.502117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.502783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.503083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.503337 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.504016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.506120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.536305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:53.541324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.541984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.542267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.542544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.543261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.544882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.555063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1228/2451] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:25:53.559430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.570057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac205c-42e7-4ef5-b7b2-361ea0955a8f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.574909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd909-059d-447e-8325-1dcb2ac7c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.575772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd909-059d-447e-8325-1dcb2ac7c718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.576056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd909-059d-447e-8325-1dcb2ac7c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.576384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd909-059d-447e-8325-1dcb2ac7c718 admin admin] PATH_INFO: `/v3/projects/daede71cdc204e86a38a267727d94e82/users/10fbcca5559341408eef51f1bf72247c/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.578660 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd909-059d-447e-8325-1dcb2ac7c718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daede71cdc204e86a38a267727d94e82, user_id=10fbcca5559341408eef51f1bf72247c, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.581523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd909-059d-447e-8325-1dcb2ac7c718 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.592254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1229/2452] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:53 2022] PUT /identity/v3/projects/daede71cdc204e86a38a267727d94e82/users/10fbcca5559341408eef51f1bf72247c/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:53.609973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25269ad4-3063-492f-8d8b-ba73950a890c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.610262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25269ad4-3063-492f-8d8b-ba73950a890c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.610543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25269ad4-3063-492f-8d8b-ba73950a890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.628433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1224/2453] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:25:53 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:25:53.629673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:53.629803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.638794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-25269ad4-3063-492f-8d8b-ba73950a890c None None] MFA Rules not processed for user `10fbcca5559341408eef51f1bf72247c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:53.639848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a462b-5fa7-4c9c-ba42-affa716ffe4c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.640306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-25269ad4-3063-492f-8d8b-ba73950a890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:53.705745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.706613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.707096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.707642 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.708569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.710376 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.726332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1230/2454] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:53.727207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1225/2455] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:25:53.732462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25269ad4-3063-492f-8d8b-ba73950a890c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.739857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.741637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:53.748345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25269ad4-3063-492f-8d8b-ba73950a890c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.755334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.756676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.757775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.758111 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] PATH_INFO: `/v3/projects/cf3099353e3246a5afadcb3d2988d6a4/users/8fbbc6de687f49fdaddc22698db6ccde/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.776904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3099353e3246a5afadcb3d2988d6a4, user_id=8fbbc6de687f49fdaddc22698db6ccde, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.780497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.806923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697f95-30f1-448e-81ad-ef62aae394cc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:53.811083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:53.812159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:53.812480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:53.812757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:53.823695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:53.825577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:53.837691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1226/2456] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:53.940871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.947579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1231/2457] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:53 2022] PUT /identity/v3/projects/cf3099353e3246a5afadcb3d2988d6a4/users/8fbbc6de687f49fdaddc22698db6ccde/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:53.950019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:53.950677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfcc4-5c22-478c-ac89-5c3ac699e894 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:54.006628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:54.007193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:54.007471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:54.007743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:54.020426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8f4de-9562-47c4-8baa-a9d965b8cbee admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:54.026044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:54.026697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:54.026976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:54.027301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:54.028017 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:54.030252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:54.042377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:54.042534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1232/2458] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:25:54.044952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:54.055662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a560-8637-4bcc-83eb-2c06ece35331 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:54.060893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb53fa-cc20-4e7c-afc4-e094ce337168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:54.062214 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb53fa-cc20-4e7c-afc4-e094ce337168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:54.062493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb53fa-cc20-4e7c-afc4-e094ce337168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:54.062763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb53fa-cc20-4e7c-afc4-e094ce337168 admin admin] PATH_INFO: `/v3/projects/cf3099353e3246a5afadcb3d2988d6a4/users/8fbbc6de687f49fdaddc22698db6ccde/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:54.064758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb53fa-cc20-4e7c-afc4-e094ce337168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3099353e3246a5afadcb3d2988d6a4, user_id=8fbbc6de687f49fdaddc22698db6ccde, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:54.067417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb53fa-cc20-4e7c-afc4-e094ce337168 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:54.070284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:54.072093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:54.078853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1233/2459] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:25:54 2022] PUT /identity/v3/projects/cf3099353e3246a5afadcb3d2988d6a4/users/8fbbc6de687f49fdaddc22698db6ccde/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:25:54.082294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1227/2460] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:54.088883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008507-06bc-435e-8618-0914b0e22378 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:54.089201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008507-06bc-435e-8618-0914b0e22378 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:54.089644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008507-06bc-435e-8618-0914b0e22378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:54.118478 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-62008507-06bc-435e-8618-0914b0e22378 None None] MFA Rules not processed for user `8fbbc6de687f49fdaddc22698db6ccde`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:54.119706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62008507-06bc-435e-8618-0914b0e22378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:54.163086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:54.190243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1234/2461] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:54.202205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:54.204605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:54.215866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac873c95-d3e1-4ccb-8392-a5e08b48217c service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:54.268159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:54.268865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:54.269147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:54.269441 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:54.278660 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:54.281025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:54.290537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1228/2462] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:54.507203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62008507-06bc-435e-8618-0914b0e22378 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:54.517391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62008507-06bc-435e-8618-0914b0e22378 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:54.521059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7830dc-fda3-4890-b27a-c81d870846ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:54.521628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7830dc-fda3-4890-b27a-c81d870846ad service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:54.521906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7830dc-fda3-4890-b27a-c81d870846ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:54.522177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7830dc-fda3-4890-b27a-c81d870846ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:54.580817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7830dc-fda3-4890-b27a-c81d870846ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:54.582639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7830dc-fda3-4890-b27a-c81d870846ad service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:54.592109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1235/2463] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:25:57.226131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:57.293329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6923eca-eda0-483c-9c37-e135a3836da2 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:57.298343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:57.301709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:57.301709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:57.301709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] PATH_INFO: `/v3/users/0c236d015c5e4b6ab061e78273a8af93` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:57.301709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c236d015c5e4b6ab061e78273a8af93)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:57.302881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:57.545704 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c236d015c5e4b6ab061e78273a8af93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:57.557578 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c236d015c5e4b6ab061e78273a8af93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:57.565455 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c236d015c5e4b6ab061e78273a8af93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:57.566168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c236d015c5e4b6ab061e78273a8af93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:57.567872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:57.690545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c236d015c5e4b6ab061e78273a8af93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:57.697409 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1229/2464] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:57 2022] DELETE /identity/v3/users/0c236d015c5e4b6ab061e78273a8af93 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:57.706513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:57.707008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:57.707217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:57.724810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:57.726051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:57.832518 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1236/2465] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:25:57.835026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:57.837147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:57.901296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f61d-5ac2-4158-a871-c393833f4b74 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:57.904980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:57.905664 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:57.905947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:57.906228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:57.915357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:57.916829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:57.927328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1230/2466] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:25:58.402808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:58.404247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:58.421391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac36f5-9629-41e2-8eeb-fa64b11309cc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:58.428045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:58.439067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:58.439067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:58.439067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] PATH_INFO: `/v3/projects/63940e11d38849c7b063920d36b797ba` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:58.439067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=63940e11d38849c7b063920d36b797ba)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:58.439067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:58.555276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63940e11d38849c7b063920d36b797ba', 'request_id': 'req-864b2a83-b19a-4cbe-9977-44a0e96f66ea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.641994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63940e11d38849c7b063920d36b797ba', 'request_id': 'req-864b2a83-b19a-4cbe-9977-44a0e96f66ea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.648868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63940e11d38849c7b063920d36b797ba', 'request_id': 'req-864b2a83-b19a-4cbe-9977-44a0e96f66ea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.655886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:58.660820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] The token cache is being invalidate because project 63940e11d38849c7b063920d36b797ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:58.661101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.661760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.663263 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1237/2467] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:58 2022] DELETE /identity/v3/projects/63940e11d38849c7b063920d36b797ba => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:58.667186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:58.677296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe95fb4-9c48-4a2e-b217-4090281048c4 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:58.736665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:58.737526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:58.737798 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:58.738065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] PATH_INFO: `/v3/users/10fbcca5559341408eef51f1bf72247c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:58.739243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10fbcca5559341408eef51f1bf72247c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:58.741195 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:58.938448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10fbcca5559341408eef51f1bf72247c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.954864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10fbcca5559341408eef51f1bf72247c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.962775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10fbcca5559341408eef51f1bf72247c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:58.963549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10fbcca5559341408eef51f1bf72247c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:59.067456 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8a5ed9c-5839-496e-b7a1-fecd9cad2145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10fbcca5559341408eef51f1bf72247c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:59.074048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1231/2468] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:25:58 2022] DELETE /identity/v3/users/10fbcca5559341408eef51f1bf72247c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:59.530693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:25:59.532226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:59.545282 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b2a83-b19a-4cbe-9977-44a0e96f66ea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:25:59.605892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:25:59.606731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:59.607008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:59.607276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] PATH_INFO: `/v3/projects/daede71cdc204e86a38a267727d94e82` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:59.608482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daede71cdc204e86a38a267727d94e82)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:25:59.610444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:25:59.775901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daede71cdc204e86a38a267727d94e82', 'request_id': 'req-6fa80a7c-00a6-4d19-bea5-92e193a979a0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:59.864006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daede71cdc204e86a38a267727d94e82', 'request_id': 'req-6fa80a7c-00a6-4d19-bea5-92e193a979a0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:59.870671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daede71cdc204e86a38a267727d94e82', 'request_id': 'req-6fa80a7c-00a6-4d19-bea5-92e193a979a0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:59.881250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] The token cache is being invalidate because project daede71cdc204e86a38a267727d94e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:25:59.881536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:59.882172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6fa80a7c-00a6-4d19-bea5-92e193a979a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:25:59.883708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1238/2469] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:25:59 2022] DELETE /identity/v3/projects/daede71cdc204e86a38a267727d94e82 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:25:59.888929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ed1f-3e57-461d-882a-2e095a6acd4a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:59.889418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ed1f-3e57-461d-882a-2e095a6acd4a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:59.889525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ed1f-3e57-461d-882a-2e095a6acd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:59.907242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4de4ed1f-3e57-461d-882a-2e095a6acd4a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:59.909081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4de4ed1f-3e57-461d-882a-2e095a6acd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:25:59.917838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:25:59.969773 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1232/2470] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:25:59.978529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6078-a614-436b-aedd-668473ed707c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:25:59.978838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6078-a614-436b-aedd-668473ed707c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:25:59.979110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e6078-a614-436b-aedd-668473ed707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:25:59.997277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-627e6078-a614-436b-aedd-668473ed707c None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:25:59.998464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-627e6078-a614-436b-aedd-668473ed707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:00.006815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1239/2471] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:00.010966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ed1f-3e57-461d-882a-2e095a6acd4a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.021715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ed1f-3e57-461d-882a-2e095a6acd4a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.026415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.027009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.027317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.027621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.028383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:00.028688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.030310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:00.043473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1233/2472] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:26:00.047534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6078-a614-436b-aedd-668473ed707c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.057016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e6078-a614-436b-aedd-668473ed707c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.061991 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.062631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.062912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.063187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.063871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.065806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:00.177708 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1240/2473] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:00 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:00.181727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.192333 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8453a97-ecd7-460c-94f9-063110ef5a6f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.251485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.252292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.252505 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.252888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.253593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.255516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:00.358471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1234/2474] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:00 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:00.362641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.372873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7a86-3235-451a-9f6c-e77c94c5a948 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.378331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.378982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.379265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.379546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.380300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.381907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:00.392323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1241/2475] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:00.397338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.407228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7652e8c-9786-4a49-ab25-d59b2eb77b68 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.412368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea3b8-83cd-460a-9aa4-af1ff1a91072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.413015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea3b8-83cd-460a-9aa4-af1ff1a91072 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.413293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea3b8-83cd-460a-9aa4-af1ff1a91072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.413566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea3b8-83cd-460a-9aa4-af1ff1a91072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.414280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea3b8-83cd-460a-9aa4-af1ff1a91072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.415852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea3b8-83cd-460a-9aa4-af1ff1a91072 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:00.426162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1235/2476] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:00.430143 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.441603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce120-d96a-4cd5-baf6-caa9631221c2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.446149 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.447001 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.447278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.447551 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] PATH_INFO: `/v3/projects/e5c02cc6327e457599c070f2d6bf2c58/users/e39a0a32a68145fc859b905e87669f76/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.462591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c02cc6327e457599c070f2d6bf2c58, user_id=e39a0a32a68145fc859b905e87669f76, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.465278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:00.547567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1242/2477] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:00 2022] PUT /identity/v3/projects/e5c02cc6327e457599c070f2d6bf2c58/users/e39a0a32a68145fc859b905e87669f76/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:00.557569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdcf80-1eeb-472b-a95b-1a41e495e4be None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.564222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdcf80-1eeb-472b-a95b-1a41e495e4be None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.564222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdcf80-1eeb-472b-a95b-1a41e495e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.586685 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7fbdcf80-1eeb-472b-a95b-1a41e495e4be None None] MFA Rules not processed for user `e39a0a32a68145fc859b905e87669f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:00.587921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7fbdcf80-1eeb-472b-a95b-1a41e495e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:00.651520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1236/2478] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:00.655892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.685390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:00.716963 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5505c-2287-4ec4-a9a9-991c9897c720 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.722595 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.723248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.723527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.723801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.724520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.726410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:00.857656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1243/2479] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:00 2022] POST /identity/v3/projects => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:00.862783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdcf80-1eeb-472b-a95b-1a41e495e4be None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:00.873451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdcf80-1eeb-472b-a95b-1a41e495e4be None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:00.878571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:00.929007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:00.929633 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:00.929855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:00.930127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:00.930810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:00.932754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:01.061952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1237/2480] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:00 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:01.066563 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:01.077091 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8397-82de-4ca0-9f4a-8ce31496625f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:01.082534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:01.083181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:01.083463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:01.083738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:01.084492 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:01.086177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:01.097586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1244/2481] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:01.101927 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:01.112969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119915-09ba-4271-add9-bc24805a9afe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:01.117557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:01.118423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:01.118700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:01.118972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] PATH_INFO: `/v3/projects/a7bde0bc94c04208b9facd636e5f7679/users/cf4c824b25874a589e830ab12f67d50a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:01.133867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bde0bc94c04208b9facd636e5f7679, user_id=cf4c824b25874a589e830ab12f67d50a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:01.136688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:01.250244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1238/2482] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:01 2022] PUT /identity/v3/projects/a7bde0bc94c04208b9facd636e5f7679/users/cf4c824b25874a589e830ab12f67d50a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:01.258606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:01.268471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1e80-7f0b-49ee-8f8d-f3699a2e2f62 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:01.325876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb490-3d8d-4935-9d9f-e832a41852c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:01.326565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb490-3d8d-4935-9d9f-e832a41852c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:01.328704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb490-3d8d-4935-9d9f-e832a41852c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:01.328704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb490-3d8d-4935-9d9f-e832a41852c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:01.328704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb490-3d8d-4935-9d9f-e832a41852c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:01.329429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb490-3d8d-4935-9d9f-e832a41852c1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:01.344736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1245/2483] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:01.346668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:01.357525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff60ef5-3bd2-4fad-a0c7-d75b8fcf6740 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:01.363957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:01.364873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:01.365152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:01.365425 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] PATH_INFO: `/v3/projects/a7bde0bc94c04208b9facd636e5f7679/users/cf4c824b25874a589e830ab12f67d50a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:01.367411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bde0bc94c04208b9facd636e5f7679, user_id=cf4c824b25874a589e830ab12f67d50a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:01.370188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:01.382325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1239/2484] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:01 2022] PUT /identity/v3/projects/a7bde0bc94c04208b9facd636e5f7679/users/cf4c824b25874a589e830ab12f67d50a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:01.393391 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb446-4e3c-4523-90e0-a9bbd295e13d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:01.393720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb446-4e3c-4523-90e0-a9bbd295e13d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:01.393996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb446-4e3c-4523-90e0-a9bbd295e13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:01.421052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-598eb446-4e3c-4523-90e0-a9bbd295e13d None None] MFA Rules not processed for user `cf4c824b25874a589e830ab12f67d50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:01.422251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-598eb446-4e3c-4523-90e0-a9bbd295e13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:01.491334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1246/2485] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:01.502906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:01.504541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:01.561878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f752b-f50f-48b2-8658-141b28350aa3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:01.565733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:01.566300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:01.566581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:01.566858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:01.580108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:01.582483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:01.592400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1240/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:01.805790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eb446-4e3c-4523-90e0-a9bbd295e13d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:01.816177 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eb446-4e3c-4523-90e0-a9bbd295e13d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:01.819743 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:01.820397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:01.820677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:01.820947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:01.840432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:01.878247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:01.879735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:01.889369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1247/2487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:08.609316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:08.678744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f7d5-1664-4c3f-a7ef-f72aa8c0780e service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:08.683394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:08.684572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:08.684851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:08.685120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] PATH_INFO: `/v3/users/e39a0a32a68145fc859b905e87669f76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:08.686309 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39a0a32a68145fc859b905e87669f76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:08.688244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:08.693744 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:08.787756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:08.789133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:08.850599 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ee2af-339b-42e6-9549-bccbd0f30736 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:08.855009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48bf85-f5f3-4959-b1f8-4fa9844022fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:08.855654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48bf85-f5f3-4959-b1f8-4fa9844022fe service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:08.856012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48bf85-f5f3-4959-b1f8-4fa9844022fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:08.856393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48bf85-f5f3-4959-b1f8-4fa9844022fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:08.858154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-de48bf85-f5f3-4959-b1f8-4fa9844022fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:08.870750 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48bf85-f5f3-4959-b1f8-4fa9844022fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:08.872232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48bf85-f5f3-4959-b1f8-4fa9844022fe service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:08.882615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1248/2488] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:08.937105 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39a0a32a68145fc859b905e87669f76'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:08.954049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39a0a32a68145fc859b905e87669f76'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:08.961727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39a0a32a68145fc859b905e87669f76'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:08.962474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39a0a32a68145fc859b905e87669f76'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:09.058294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39a0a32a68145fc859b905e87669f76'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:09.065528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1241/2489] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:08 2022] DELETE /identity/v3/users/e39a0a32a68145fc859b905e87669f76 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:09.070770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:09.071129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:09.071406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:09.091236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:09.092500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:09.157394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1249/2490] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:09.168033 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:09.169597 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:09.231464 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5105233-aa09-4b3a-a7e4-6fa4a03f77c7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:09.235074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:09.235718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:09.235999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:09.236369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:09.246678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:09.248393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:09.259757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1242/2491] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:09.817966 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:09.819400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:09.833231 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac041b48-eaa5-4d83-80f1-ac18f52bf739 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:09.838427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:09.839366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:09.839818 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:09.840479 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] PATH_INFO: `/v3/projects/e5c02cc6327e457599c070f2d6bf2c58` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:09.841709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c02cc6327e457599c070f2d6bf2c58)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:09.845761 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:09.995294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c02cc6327e457599c070f2d6bf2c58', 'request_id': 'req-4a991a35-2424-4ecf-90f6-93e0c4c0997a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.115527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c02cc6327e457599c070f2d6bf2c58', 'request_id': 'req-4a991a35-2424-4ecf-90f6-93e0c4c0997a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.117873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:10.122668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c02cc6327e457599c070f2d6bf2c58', 'request_id': 'req-4a991a35-2424-4ecf-90f6-93e0c4c0997a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.134666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] The token cache is being invalidate because project e5c02cc6327e457599c070f2d6bf2c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:10.136915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.136915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.140334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1250/2492] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:09 2022] DELETE /identity/v3/projects/e5c02cc6327e457599c070f2d6bf2c58 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:10.141478 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:10.153570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403714-0586-4de9-b006-9400ff4f4223 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:10.216118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:10.217009 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:10.217290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:10.217686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] PATH_INFO: `/v3/users/cf4c824b25874a589e830ab12f67d50a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:10.218888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4c824b25874a589e830ab12f67d50a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:10.220878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:10.331764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:10.431230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4c824b25874a589e830ab12f67d50a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.443574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4c824b25874a589e830ab12f67d50a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.450941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4c824b25874a589e830ab12f67d50a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.451811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4c824b25874a589e830ab12f67d50a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.593152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-13d8f8af-ad2f-4b4d-944b-e6da18cc0a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4c824b25874a589e830ab12f67d50a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:10.602298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1243/2493] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:10 2022] DELETE /identity/v3/users/cf4c824b25874a589e830ab12f67d50a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:11.190557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:11.193349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:11.233024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991a35-2424-4ecf-90f6-93e0c4c0997a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:11.297019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:11.297868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:11.298183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:11.298455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] PATH_INFO: `/v3/projects/a7bde0bc94c04208b9facd636e5f7679` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:11.299622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7bde0bc94c04208b9facd636e5f7679)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:11.301946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:11.478930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bde0bc94c04208b9facd636e5f7679', 'request_id': 'req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:11.586989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bde0bc94c04208b9facd636e5f7679', 'request_id': 'req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:11.595036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bde0bc94c04208b9facd636e5f7679', 'request_id': 'req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:11.607138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] The token cache is being invalidate because project a7bde0bc94c04208b9facd636e5f7679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:11.607420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:11.608081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea8e1eaf-2bbc-4e0c-8bd2-f210e2aba275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:11.609678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1251/2494] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:11 2022] DELETE /identity/v3/projects/a7bde0bc94c04208b9facd636e5f7679 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:11.614749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57b58d-aaf3-4088-87c6-76842027bbaa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:11.615242 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57b58d-aaf3-4088-87c6-76842027bbaa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:11.615336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57b58d-aaf3-4088-87c6-76842027bbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:11.633849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2a57b58d-aaf3-4088-87c6-76842027bbaa None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:11.635061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2a57b58d-aaf3-4088-87c6-76842027bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:11.702547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1244/2495] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:11.710933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c9f1-5916-408d-a3b6-4ba540b8fcc6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:11.711283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c9f1-5916-408d-a3b6-4ba540b8fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:11.711712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c9f1-5916-408d-a3b6-4ba540b8fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:11.733139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fba6c9f1-5916-408d-a3b6-4ba540b8fcc6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:11.734837 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fba6c9f1-5916-408d-a3b6-4ba540b8fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:11.749584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1252/2496] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:26:11.751265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57b58d-aaf3-4088-87c6-76842027bbaa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:11.763222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57b58d-aaf3-4088-87c6-76842027bbaa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:11.773321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:11.774058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:11.774348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:11.774780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:11.775527 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:11.775839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:11.777694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:11.792652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1245/2497] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:26:11.797814 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6c9f1-5916-408d-a3b6-4ba540b8fcc6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:11.807415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6c9f1-5916-408d-a3b6-4ba540b8fcc6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:11.812953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:11.813849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:11.814078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:11.814376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:11.815151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:11.819249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:11.919841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1253/2498] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:11 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:11.924187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:11.935136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eb02f-bf8e-43bf-9def-67af88bead34 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:11.993911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:11.994620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:11.994905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:11.995184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:11.995874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:11.997824 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:12.205881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1246/2499] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:11 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:12.210530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:12.228641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6dbe-339a-47ed-a4ed-b797c8002bc9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:12.235901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:12.236643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:12.236950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:12.237230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:12.238865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:12.241260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:12.260407 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1254/2500] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:12.266625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:12.278841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67f15-4713-4ee1-838d-0633771f7dac admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:12.283986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79494801-593a-4760-a612-2765387f512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:12.284874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494801-593a-4760-a612-2765387f512c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:12.285259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494801-593a-4760-a612-2765387f512c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:12.286194 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494801-593a-4760-a612-2765387f512c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:12.286901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79494801-593a-4760-a612-2765387f512c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:12.288644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79494801-593a-4760-a612-2765387f512c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:12.302472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1247/2501] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:12.306425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:12.317350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2d6d0-6716-44f0-bf2a-bf808c1e8318 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:12.329516 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:12.333238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:12.333238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:12.333238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] PATH_INFO: `/v3/projects/1423313740044c00944b8d945a454f20/users/524a7306333942979bed1caa120f4177/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:12.349623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1423313740044c00944b8d945a454f20, user_id=524a7306333942979bed1caa120f4177, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:12.352425 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:12.448560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1255/2502] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:12 2022] PUT /identity/v3/projects/1423313740044c00944b8d945a454f20/users/524a7306333942979bed1caa120f4177/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:12.465925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf304c1-8ada-4ffe-a8fc-359a9cd43c97 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:12.466605 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf304c1-8ada-4ffe-a8fc-359a9cd43c97 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:12.466986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf304c1-8ada-4ffe-a8fc-359a9cd43c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:12.490194 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:12.498936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fcf304c1-8ada-4ffe-a8fc-359a9cd43c97 None None] MFA Rules not processed for user `524a7306333942979bed1caa120f4177`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:12.501907 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fcf304c1-8ada-4ffe-a8fc-359a9cd43c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:12.574063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1248/2503] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:12.578706 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:12.599217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:12.668736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36e699-be6f-4475-b9da-e135c39b0348 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:12.673737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:12.674554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:12.674840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:12.675115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:12.675943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:12.677893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:12.810312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1256/2504] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:12 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:12.814210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf304c1-8ada-4ffe-a8fc-359a9cd43c97 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:12.825341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf304c1-8ada-4ffe-a8fc-359a9cd43c97 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:12.884050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:12.884689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:12.885002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:12.885249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:12.885968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:12.887903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:12.925616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:12.927501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:12.943532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ac83-309a-4404-9365-223318b9dfea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:12.948395 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:12.949260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:12.949543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:12.949895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] PATH_INFO: `/v3/users/6935dece64c14ab28be74275d43f07ab` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:12.951029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6935dece64c14ab28be74275d43f07ab)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:12.953030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:12.985886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1249/2505] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:12 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:12.990407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:13.002078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e11665-ad85-4a0d-b16f-16ba24e2faa6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:13.007043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:13.007782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:13.008142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:13.008520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:13.009321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:13.011453 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:13.022628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1250/2506] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:26:13.026747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:13.037232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb791-d963-425a-abc4-3630189d7f0e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:13.041872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:13.046928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:13.046928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:13.046928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] PATH_INFO: `/v3/projects/7ea18f3b4bc14e4895b0ebb5ad15e26f/users/6b7a4276b8a54134927c1ea6377f6a9e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:13.058487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea18f3b4bc14e4895b0ebb5ad15e26f, user_id=6b7a4276b8a54134927c1ea6377f6a9e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:13.061526 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:13.193471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1251/2507] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:13 2022] PUT /identity/v3/projects/7ea18f3b4bc14e4895b0ebb5ad15e26f/users/6b7a4276b8a54134927c1ea6377f6a9e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:13.196218 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:13.264897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ccc6d-9b48-443b-bde2-c675f97c01a0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:13.270389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:13.271762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:13.272051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:13.272390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:13.273159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:13.274761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:13.285976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1252/2508] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:26:13.290394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:13.300389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43984795-db40-43ff-a3aa-b54f9114db35 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:13.305238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da9a6a-4b68-4d16-92ea-dd7d71a6c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:13.306115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9a6a-4b68-4d16-92ea-dd7d71a6c572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:13.306397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9a6a-4b68-4d16-92ea-dd7d71a6c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:13.306782 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9a6a-4b68-4d16-92ea-dd7d71a6c572 admin admin] PATH_INFO: `/v3/projects/7ea18f3b4bc14e4895b0ebb5ad15e26f/users/6b7a4276b8a54134927c1ea6377f6a9e/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:13.308937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da9a6a-4b68-4d16-92ea-dd7d71a6c572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea18f3b4bc14e4895b0ebb5ad15e26f, user_id=6b7a4276b8a54134927c1ea6377f6a9e, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:13.311580 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da9a6a-4b68-4d16-92ea-dd7d71a6c572 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:13.322953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1253/2509] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:13 2022] PUT /identity/v3/projects/7ea18f3b4bc14e4895b0ebb5ad15e26f/users/6b7a4276b8a54134927c1ea6377f6a9e/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:13.334494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:13.334784 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:13.335095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:13.352183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6935dece64c14ab28be74275d43f07ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:13.359168 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6935dece64c14ab28be74275d43f07ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:13.359871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6935dece64c14ab28be74275d43f07ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:13.360507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6935dece64c14ab28be74275d43f07ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:13.361972 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] MFA Rules not processed for user `6b7a4276b8a54134927c1ea6377f6a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:13.363189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:13.377240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6935dece64c14ab28be74275d43f07ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:13.445264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1254/2510] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:26:13.456476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:13.457919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:13.472830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1257/2511] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:12 2022] DELETE /identity/v3/users/6935dece64c14ab28be74275d43f07ab => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:13.520434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb790-9e2e-46a6-915d-1e23640d2d3d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:13.603754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:13.604529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:13.604813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:13.605087 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:13.685409 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:13.686878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:13.698618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1255/2512] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:13.817011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:13.817011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:13.838942 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:13.904651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0e9e-bfa9-4ede-9085-e1ce64065e61 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:13.911841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:13.912662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:13.925032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:13.925032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] PATH_INFO: `/v3/projects/e1244423396f45beb9124e6d04e0381b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:13.925032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1244423396f45beb9124e6d04e0381b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:13.925032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.059555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:14.080627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1244423396f45beb9124e6d04e0381b', 'request_id': 'req-aac15ae3-a199-4861-a194-efefeadad073'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.159343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.159343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.170099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3aad-185a-45b9-913f-31d5241a1f18 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.176206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1244423396f45beb9124e6d04e0381b', 'request_id': 'req-aac15ae3-a199-4861-a194-efefeadad073'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.184254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1244423396f45beb9124e6d04e0381b', 'request_id': 'req-aac15ae3-a199-4861-a194-efefeadad073'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.201370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] The token cache is being invalidate because project e1244423396f45beb9124e6d04e0381b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:14.201370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.202020 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aac15ae3-a199-4861-a194-efefeadad073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.203712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1258/2513] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:13 2022] DELETE /identity/v3/projects/e1244423396f45beb9124e6d04e0381b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:14.209349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad307929-0dea-461c-9b41-e9580cbd9af6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.210357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad307929-0dea-461c-9b41-e9580cbd9af6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.210357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad307929-0dea-461c-9b41-e9580cbd9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.231738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ad307929-0dea-461c-9b41-e9580cbd9af6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:14.238175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ad307929-0dea-461c-9b41-e9580cbd9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.247530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.248677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.248677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.248940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.250887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.298734 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1259/2514] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:26:14.306807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.307195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.307530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.319423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.320890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.325808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:14.327046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.333924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1256/2515] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:14.338094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1260/2516] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:26:14.342167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.354925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc4c7-7cf0-4663-a9e7-919f10a04a3e service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.359046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.361399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.373579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.374131 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.374413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.374690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.376603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:14.378739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.380761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.381963 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf0b1c-c4d5-4fa7-b16a-13388695c335 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.387867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.393162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:14.393318 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.393318 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.393318 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] PATH_INFO: `/v3/users/524a7306333942979bed1caa120f4177` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.396223 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524a7306333942979bed1caa120f4177)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.398985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.405871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1257/2517] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:26:14.409495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.423814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255a6b-f531-4084-9786-f0bd6b4cc1a8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.430637 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.431336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.431627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.431906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.432674 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.434872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.537672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1258/2518] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:14 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:14.541509 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.596619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524a7306333942979bed1caa120f4177'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.603791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524a7306333942979bed1caa120f4177'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.604501 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524a7306333942979bed1caa120f4177'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.605112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524a7306333942979bed1caa120f4177'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.615576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09480c0-b72a-4c93-b180-895ef32c70c8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.620156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8d3253e6-291c-4a25-8a34-aa29c3213f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524a7306333942979bed1caa120f4177'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:14.620825 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.621572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.621996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.622893 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.623310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.625357 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.687458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:14.693569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1261/2519] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:14 2022] DELETE /identity/v3/users/524a7306333942979bed1caa120f4177 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:14.698032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.698328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.698608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.711098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:14.717396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:14.718604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.759234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1259/2520] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:14 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:14.760338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.762109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.774813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745568-f6b1-4c3b-928e-02973457bfcb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.783002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1262/2521] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:26:14.784568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.787799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.787799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.787799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.787799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.794811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.795002 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.796437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:14.807152 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1260/2522] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:14.820244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.831581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db34392-3306-4e5d-ab50-ae77a9bb4e55 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.837430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.838207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.839216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.839216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.839866 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.841630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.853177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1261/2523] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:14.857484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:14.869474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ec8b-0738-451f-90ef-d82d6094b1f7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.872874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f141b1-7687-4ccf-b760-c0791afebea7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:14.874708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.875590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.875872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.876171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] PATH_INFO: `/v3/projects/2c2e4caa55e643e09f0d5c36e5fae9a4/users/55f125e35cc54fe7818789e2f553e0ad/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.876604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2669-c6c1-4a28-bf48-aa6e1d796c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:14.877308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2669-c6c1-4a28-bf48-aa6e1d796c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:14.877659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2669-c6c1-4a28-bf48-aa6e1d796c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:14.878004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2669-c6c1-4a28-bf48-aa6e1d796c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:14.888183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2669-c6c1-4a28-bf48-aa6e1d796c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.889623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2669-c6c1-4a28-bf48-aa6e1d796c25 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.892620 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2e4caa55e643e09f0d5c36e5fae9a4, user_id=55f125e35cc54fe7818789e2f553e0ad, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:14.895908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:14.900434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1263/2524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:15.005607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1262/2525] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:14 2022] PUT /identity/v3/projects/2c2e4caa55e643e09f0d5c36e5fae9a4/users/55f125e35cc54fe7818789e2f553e0ad/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:15.015854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:15.016158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:15.016547 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:15.043313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] MFA Rules not processed for user `55f125e35cc54fe7818789e2f553e0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:15.044682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:15.111486 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1264/2526] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:15.123188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:15.126611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:15.198723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317700-7fdf-4e80-81e6-1e506730ff54 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:15.204182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:15.204844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:15.205129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:15.205412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:15.213523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:15.215107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:15.224072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1263/2527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:15.536288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:15.538041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:15.606174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11673fae-217e-4fa0-8d65-2fa8f4e9cac1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:15.610855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:15.611633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:15.611915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:15.612190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] PATH_INFO: `/v3/projects/1423313740044c00944b8d945a454f20` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:15.614114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=1423313740044c00944b8d945a454f20)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:15.616018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:15.773427 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1423313740044c00944b8d945a454f20', 'request_id': 'req-6c67241a-652b-49e5-b76c-c61f195ddcda'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:15.840928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1423313740044c00944b8d945a454f20', 'request_id': 'req-6c67241a-652b-49e5-b76c-c61f195ddcda'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:15.847561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1423313740044c00944b8d945a454f20', 'request_id': 'req-6c67241a-652b-49e5-b76c-c61f195ddcda'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:15.858855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:15.861770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] The token cache is being invalidate because project 1423313740044c00944b8d945a454f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:15.862385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:15.863372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:15.865702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1265/2528] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:15 2022] DELETE /identity/v3/projects/1423313740044c00944b8d945a454f20 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:15.870112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:15.885448 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf54d-7bf0-42dd-ab0b-7d672ef16e75 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:15.950446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:15.951321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:15.951599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:15.951874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] PATH_INFO: `/v3/users/6b7a4276b8a54134927c1ea6377f6a9e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:15.953110 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7a4276b8a54134927c1ea6377f6a9e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:15.955049 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:15.980922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:16.186493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7a4276b8a54134927c1ea6377f6a9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:16.198857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7a4276b8a54134927c1ea6377f6a9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:16.205761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7a4276b8a54134927c1ea6377f6a9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:16.206439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7a4276b8a54134927c1ea6377f6a9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:16.283353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fcd14feb-93b1-49c1-8711-2976bc8130b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7a4276b8a54134927c1ea6377f6a9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:16.289640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1264/2529] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:15 2022] DELETE /identity/v3/users/6b7a4276b8a54134927c1ea6377f6a9e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:16.711271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:16.712770 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:16.727451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67241a-652b-49e5-b76c-c61f195ddcda admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:16.785816 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:16.786728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:16.787009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:16.787298 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] PATH_INFO: `/v3/projects/7ea18f3b4bc14e4895b0ebb5ad15e26f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:16.788500 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea18f3b4bc14e4895b0ebb5ad15e26f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:16.790408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:16.905123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea18f3b4bc14e4895b0ebb5ad15e26f', 'request_id': 'req-467190de-03e6-4be7-ad32-f413425f6ac5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:16.989821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea18f3b4bc14e4895b0ebb5ad15e26f', 'request_id': 'req-467190de-03e6-4be7-ad32-f413425f6ac5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:16.996875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea18f3b4bc14e4895b0ebb5ad15e26f', 'request_id': 'req-467190de-03e6-4be7-ad32-f413425f6ac5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:17.004962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:17.008785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] The token cache is being invalidate because project 7ea18f3b4bc14e4895b0ebb5ad15e26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:17.009096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:17.009753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-467190de-03e6-4be7-ad32-f413425f6ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:17.012082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1266/2530] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:16 2022] DELETE /identity/v3/projects/7ea18f3b4bc14e4895b0ebb5ad15e26f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:17.018025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b78dd-1590-4221-9ae3-f8ce196167ad None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.018501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b78dd-1590-4221-9ae3-f8ce196167ad None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.018795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b78dd-1590-4221-9ae3-f8ce196167ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.041161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f22b78dd-1590-4221-9ae3-f8ce196167ad None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:17.045585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f22b78dd-1590-4221-9ae3-f8ce196167ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:17.105894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1265/2531] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:17.113943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa043-c6ff-4f1d-a283-919408b268cd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.120335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa043-c6ff-4f1d-a283-919408b268cd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.120335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa043-c6ff-4f1d-a283-919408b268cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.133081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-aa7fa043-c6ff-4f1d-a283-919408b268cd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:17.134280 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aa7fa043-c6ff-4f1d-a283-919408b268cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:17.142292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1267/2532] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:17.147186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b78dd-1590-4221-9ae3-f8ce196167ad None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:17.156838 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b78dd-1590-4221-9ae3-f8ce196167ad None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:17.161855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:17.167529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.167529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.167529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.167529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:17.167529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:17.167529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:17.178406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1266/2533] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:26:17.182646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa043-c6ff-4f1d-a283-919408b268cd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:17.193843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa043-c6ff-4f1d-a283-919408b268cd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:17.198527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:17.199176 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.199461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.199849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.200588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:17.202489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:17.309114 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1268/2534] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:17 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:17.313254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:17.323859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270f5d-74a2-40e4-a619-f34c435a80bb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:17.379847 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:17.380544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.380828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.381100 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.381774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:17.383700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:17.556828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1267/2535] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:17 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:17.561315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:17.572247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a919c-7a6e-494e-a9fe-1c23106e40b6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:17.577081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:17.577744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.578023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.578296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.579019 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:17.580661 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:17.591963 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1269/2536] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:17.595911 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:17.606992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd47ac-c499-4681-9303-693e8ade0577 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:17.611625 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a17a2b-7889-49b7-87eb-9bf13511f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:17.612301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a17a2b-7889-49b7-87eb-9bf13511f108 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.612584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a17a2b-7889-49b7-87eb-9bf13511f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.612858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a17a2b-7889-49b7-87eb-9bf13511f108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.614210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a17a2b-7889-49b7-87eb-9bf13511f108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:17.615959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a17a2b-7889-49b7-87eb-9bf13511f108 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:17.625921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1268/2537] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:17.629893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:17.640247 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66c33-6223-4be0-8213-8deab175c21f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:17.645078 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:17.645905 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.646185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.646453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] PATH_INFO: `/v3/projects/d7dbb3f9d2464b429fd610a830d5954c/users/cd63d7077bfc4ca69038190cf6767ccf/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.661297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dbb3f9d2464b429fd610a830d5954c, user_id=cd63d7077bfc4ca69038190cf6767ccf, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:17.663958 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:17.777975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1270/2538] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:17 2022] PUT /identity/v3/projects/d7dbb3f9d2464b429fd610a830d5954c/users/cd63d7077bfc4ca69038190cf6767ccf/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:17.790137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2d0b2-6370-4542-a712-c523f33f05e6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.790553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2d0b2-6370-4542-a712-c523f33f05e6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.791016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2d0b2-6370-4542-a712-c523f33f05e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.797196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:17.818436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-67e2d0b2-6370-4542-a712-c523f33f05e6 None None] MFA Rules not processed for user `cd63d7077bfc4ca69038190cf6767ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:17.819552 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-67e2d0b2-6370-4542-a712-c523f33f05e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:17.883939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1269/2539] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:17.888446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:17.952850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145c91-fdc7-4637-b562-637dda37c71f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:17.957778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:17.958428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:17.958712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:17.958988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:17.959697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:17.961631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:18.172071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1271/2540] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:17 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:18.176101 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2d0b2-6370-4542-a712-c523f33f05e6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:18.187182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2d0b2-6370-4542-a712-c523f33f05e6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:18.243546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:18.244236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:18.244518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:18.244887 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:18.245512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:18.247422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:18.340305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1270/2541] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:18 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:18.344123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:18.354497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f0d84-03c3-4b04-a62c-1c8cc271d00d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:18.358986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:18.359627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:18.359903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:18.360174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:18.360996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:18.362578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:18.373369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1272/2542] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:18.377671 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:18.387932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce8e0-cb15-4f7d-99f1-990e03d94b20 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:18.392908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:18.393812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:18.394094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:18.394370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] PATH_INFO: `/v3/projects/92841c5e3aa3474aade7113e09720dd9/users/02f527b9a5d64c87a9cb06cd4e638556/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:18.409638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92841c5e3aa3474aade7113e09720dd9, user_id=02f527b9a5d64c87a9cb06cd4e638556, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:18.412416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:18.510127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1271/2543] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:18 2022] PUT /identity/v3/projects/92841c5e3aa3474aade7113e09720dd9/users/02f527b9a5d64c87a9cb06cd4e638556/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:18.514139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:18.524823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f0bc-2b18-41eb-aeca-94380535a2fb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:18.581140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcc003-8e56-45a0-825d-93202885e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:18.583566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcc003-8e56-45a0-825d-93202885e98e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:18.583959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcc003-8e56-45a0-825d-93202885e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:18.584809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcc003-8e56-45a0-825d-93202885e98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:18.585193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcc003-8e56-45a0-825d-93202885e98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:18.587840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcc003-8e56-45a0-825d-93202885e98e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:18.603323 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1273/2544] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:18.604634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:18.616435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980ad4-c252-4195-8c39-38ecf107992b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:18.625199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:18.625199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:18.625199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:18.625199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] PATH_INFO: `/v3/projects/92841c5e3aa3474aade7113e09720dd9/users/02f527b9a5d64c87a9cb06cd4e638556/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:18.625604 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92841c5e3aa3474aade7113e09720dd9, user_id=02f527b9a5d64c87a9cb06cd4e638556, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:18.627830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:18.639963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1272/2545] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:18 2022] PUT /identity/v3/projects/92841c5e3aa3474aade7113e09720dd9/users/02f527b9a5d64c87a9cb06cd4e638556/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:18.653833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:18.653833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:18.653833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:18.667511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:18.683120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] MFA Rules not processed for user `02f527b9a5d64c87a9cb06cd4e638556`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:18.687334 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:18.753062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1274/2546] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:18.764227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:18.765914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:18.813424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:18.824742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58ab41-4824-4116-805c-42fbd5cd302f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:18.828465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ce896-ad18-4e5b-93bb-d438d3fce925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:18.832973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce896-ad18-4e5b-93bb-d438d3fce925 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:18.832973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce896-ad18-4e5b-93bb-d438d3fce925 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:18.832973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce896-ad18-4e5b-93bb-d438d3fce925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:18.889202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ce896-ad18-4e5b-93bb-d438d3fce925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:18.890641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ce896-ad18-4e5b-93bb-d438d3fce925 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:18.899917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1273/2547] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:23.474829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:23.476404 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:23.547722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242774c-ccd0-43e7-a9ae-4ba0e5c6dff5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:23.553269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:23.554140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:23.554423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:23.554700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] PATH_INFO: `/v3/users/55f125e35cc54fe7818789e2f553e0ad` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:23.555916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f125e35cc54fe7818789e2f553e0ad)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:23.557859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:23.829116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f125e35cc54fe7818789e2f553e0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:23.836562 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f125e35cc54fe7818789e2f553e0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:23.837284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f125e35cc54fe7818789e2f553e0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:23.837895 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f125e35cc54fe7818789e2f553e0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:23.850530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f125e35cc54fe7818789e2f553e0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:23.955682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1275/2548] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:23 2022] DELETE /identity/v3/users/55f125e35cc54fe7818789e2f553e0ad => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:23.960303 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:23.960754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:23.960852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:23.977742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:23.981809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:24.041327 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1274/2549] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:24.052339 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:24.053855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:24.069604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:24.086095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:24.087564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:24.114998 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698374ac-7d95-424d-9db8-54e0db3ce653 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:24.118566 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8da3-4c0d-4e4f-a004-03c996476bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:24.119259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8da3-4c0d-4e4f-a004-03c996476bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:24.119647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8da3-4c0d-4e4f-a004-03c996476bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:24.119832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8da3-4c0d-4e4f-a004-03c996476bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:24.129826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8da3-4c0d-4e4f-a004-03c996476bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:24.131290 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8da3-4c0d-4e4f-a004-03c996476bc1 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:24.142164 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1276/2550] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:24.168109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec21cf-67b0-4d42-b499-7e4be4edba19 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:24.173596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:24.174241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:24.174574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:24.174853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:24.176739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:24.189170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:24.190683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:24.201454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1275/2551] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:24.440397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeba720-1c29-41e6-9434-f4b860bee305 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:24.440745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeba720-1c29-41e6-9434-f4b860bee305 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:24.441159 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeba720-1c29-41e6-9434-f4b860bee305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:24.470787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cdeba720-1c29-41e6-9434-f4b860bee305 None None] MFA Rules not processed for user `01fe8c57517d4ca5958ec13139aa2b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:24.472162 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cdeba720-1c29-41e6-9434-f4b860bee305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:24.533659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1277/2552] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:24.654388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:24.655940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:24.672418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0182f8-d4dc-4dee-8ff5-1a8a3a3b53cf service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:24.678071 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:24.679095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:24.679480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:24.679801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] PATH_INFO: `/v3/projects/2c2e4caa55e643e09f0d5c36e5fae9a4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:24.687560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2e4caa55e643e09f0d5c36e5fae9a4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:24.689579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:24.720562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:24.801488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2e4caa55e643e09f0d5c36e5fae9a4', 'request_id': 'req-e914aec5-9f39-437e-af82-aa4f323a2180'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:24.807852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2e4caa55e643e09f0d5c36e5fae9a4', 'request_id': 'req-e914aec5-9f39-437e-af82-aa4f323a2180'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:24.897858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2e4caa55e643e09f0d5c36e5fae9a4', 'request_id': 'req-e914aec5-9f39-437e-af82-aa4f323a2180'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:24.910754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] The token cache is being invalidate because project 2c2e4caa55e643e09f0d5c36e5fae9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:24.911045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:24.912086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e914aec5-9f39-437e-af82-aa4f323a2180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:24.913802 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1276/2553] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:24 2022] DELETE /identity/v3/projects/2c2e4caa55e643e09f0d5c36e5fae9a4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:24.918484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4349a-ed2e-4687-a56a-bad324d89e85 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:24.918773 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4349a-ed2e-4687-a56a-bad324d89e85 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:24.919057 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4349a-ed2e-4687-a56a-bad324d89e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:24.938284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6ff4349a-ed2e-4687-a56a-bad324d89e85 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:24.939503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6ff4349a-ed2e-4687-a56a-bad324d89e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:25.003637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1278/2554] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:25.012263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935849f-ee05-44b1-b49a-c8ab1ec62b83 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.012757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935849f-ee05-44b1-b49a-c8ab1ec62b83 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.012842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935849f-ee05-44b1-b49a-c8ab1ec62b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.032944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2935849f-ee05-44b1-b49a-c8ab1ec62b83 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:25.034129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2935849f-ee05-44b1-b49a-c8ab1ec62b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:25.043897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1277/2555] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:25.048316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4349a-ed2e-4687-a56a-bad324d89e85 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.060070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4349a-ed2e-4687-a56a-bad324d89e85 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.064882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.065545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.065830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.066108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.067840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:25.068161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.069797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.082258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1279/2556] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:26:25.086874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935849f-ee05-44b1-b49a-c8ab1ec62b83 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.098445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935849f-ee05-44b1-b49a-c8ab1ec62b83 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.103280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.103928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.104248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.104533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.105229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.107287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.246312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1278/2557] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:25 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:25.250313 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.260506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cafbf1-0781-42b9-9061-d8591944266a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.308010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:25.320640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.321305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.321592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.321867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.322578 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.324497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.448899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.450582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:25.470104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1280/2558] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:25 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:25.475011 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.485384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652edfa-717e-4d0d-bc9d-9aa49308a2b1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.490939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.491692 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.492053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.492422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.493224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.494827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.506699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1281/2559] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:26:25.510140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.516257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122d134-e607-479a-9007-1a4610151f20 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.520405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff69c3-4e57-4c13-9b64-ec6640bda47a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.520928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59103b2-be05-4097-a797-520575753214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.521576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59103b2-be05-4097-a797-520575753214 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.521886 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59103b2-be05-4097-a797-520575753214 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.522161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59103b2-be05-4097-a797-520575753214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.523961 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a59103b2-be05-4097-a797-520575753214 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:25.525205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.525777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.526055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.526329 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.527042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.528699 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.540190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1282/2560] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:26:25.544419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.554016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1219-1b1e-46ea-b1b5-de4ef01d201c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.559890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.560789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.561071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.561345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] PATH_INFO: `/v3/projects/0c9a316673a24516859ac845da3db5f5/users/333e532906f54fcd88635c4bd1959086/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.576636 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9a316673a24516859ac845da3db5f5, user_id=333e532906f54fcd88635c4bd1959086, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.579641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.598963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59103b2-be05-4097-a797-520575753214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.600492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59103b2-be05-4097-a797-520575753214 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.610305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1279/2561] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:25.643934 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1283/2562] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:25 2022] PUT /identity/v3/projects/0c9a316673a24516859ac845da3db5f5/users/333e532906f54fcd88635c4bd1959086/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:25.656171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d8c3-362f-4638-87f1-ead941d91de7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.656491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d8c3-362f-4638-87f1-ead941d91de7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.656816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d8c3-362f-4638-87f1-ead941d91de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.687238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2ea6d8c3-362f-4638-87f1-ead941d91de7 None None] MFA Rules not processed for user `333e532906f54fcd88635c4bd1959086`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:25.688492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2ea6d8c3-362f-4638-87f1-ead941d91de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:25.711627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:25.806384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1280/2563] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:25.807724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:25.881480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982b2e1-0d62-45bd-9c90-774575c2261e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:25.889476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:25.889476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:25.889476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:25.889476 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:25.889957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:25.891796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:25.992558 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1284/2564] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:25 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:25.996528 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d8c3-362f-4638-87f1-ead941d91de7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:26.009341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d8c3-362f-4638-87f1-ead941d91de7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:26.065480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:26.066114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.067301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.067589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:26.068313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:26.070233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:26.187092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1281/2565] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:25 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:26.191189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:26.202041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befd96f-a088-4fd8-b0e2-490800aea21a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:26.206655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:26.207459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.207746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.208055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:26.208900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:26.210573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:26.222629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1285/2566] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:26.226958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:26.237047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc658-f6be-4d1e-ba17-edd3d9e11b1a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:26.242434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:26.243320 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.243596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.243867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] PATH_INFO: `/v3/projects/b0a7b93f0bdf4d71b6e89ea6eab98b59/users/5cbe8381ba654af48dbd6b5bfc43f3ea/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:26.258975 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a7b93f0bdf4d71b6e89ea6eab98b59, user_id=5cbe8381ba654af48dbd6b5bfc43f3ea, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:26.261686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:26.376170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1282/2567] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:26 2022] PUT /identity/v3/projects/b0a7b93f0bdf4d71b6e89ea6eab98b59/users/5cbe8381ba654af48dbd6b5bfc43f3ea/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:26.383353 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:26.393809 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6ae9c-f8b0-4d86-a459-7c0fd6f8ed2e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:26.450850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502342c7-c898-418f-9e50-07539ff4ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:26.451509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502342c7-c898-418f-9e50-07539ff4ccef admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.451788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502342c7-c898-418f-9e50-07539ff4ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.452086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502342c7-c898-418f-9e50-07539ff4ccef admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:26.452834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502342c7-c898-418f-9e50-07539ff4ccef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:26.454410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502342c7-c898-418f-9e50-07539ff4ccef admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:26.459557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:26.464528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1286/2568] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:26.468768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:26.479227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a9c5f-793d-4142-ac46-693818a2d8c1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:26.484162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:26.485068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.485351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.485627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] PATH_INFO: `/v3/projects/b0a7b93f0bdf4d71b6e89ea6eab98b59/users/5cbe8381ba654af48dbd6b5bfc43f3ea/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:26.487735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a7b93f0bdf4d71b6e89ea6eab98b59, user_id=5cbe8381ba654af48dbd6b5bfc43f3ea, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:26.490947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:26.501537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1283/2569] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:26 2022] PUT /identity/v3/projects/b0a7b93f0bdf4d71b6e89ea6eab98b59/users/5cbe8381ba654af48dbd6b5bfc43f3ea/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:26.515372 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d1785-ab0d-4701-b577-56bb666a1800 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.515796 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d1785-ab0d-4701-b577-56bb666a1800 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.516147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d1785-ab0d-4701-b577-56bb666a1800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:26.550574 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f58d1785-ab0d-4701-b577-56bb666a1800 None None] MFA Rules not processed for user `5cbe8381ba654af48dbd6b5bfc43f3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:26.553082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f58d1785-ab0d-4701-b577-56bb666a1800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:26.625861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1287/2570] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:26.638237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:26.700336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831faab9-5a6d-439e-bd0f-3bba9cfb1989 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:26.703996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:26.704701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.705007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.705335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:26.716054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:26.717517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:26.727371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1284/2571] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:26.950337 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d1785-ab0d-4701-b577-56bb666a1800 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:26.960116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d1785-ab0d-4701-b577-56bb666a1800 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:26.963830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33e6c1-0d5e-45e5-810d-726e77406609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:26.964527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33e6c1-0d5e-45e5-810d-726e77406609 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:26.964791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33e6c1-0d5e-45e5-810d-726e77406609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:26.965070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33e6c1-0d5e-45e5-810d-726e77406609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:27.022433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33e6c1-0d5e-45e5-810d-726e77406609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:27.023863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33e6c1-0d5e-45e5-810d-726e77406609 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:27.033045 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1288/2572] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:36.722729 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:37.028751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=62 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:39.569343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:39.570799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:39.644437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc7994-0d0e-4ed3-bd8a-133391db2b12 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:39.650208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:39.650750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:39.651035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:39.651311 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] PATH_INFO: `/v3/users/cd63d7077bfc4ca69038190cf6767ccf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:39.652571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd63d7077bfc4ca69038190cf6767ccf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:39.654503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:39.920317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd63d7077bfc4ca69038190cf6767ccf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:39.933718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd63d7077bfc4ca69038190cf6767ccf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:39.940701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd63d7077bfc4ca69038190cf6767ccf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:39.941391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd63d7077bfc4ca69038190cf6767ccf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:40.100359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd63d7077bfc4ca69038190cf6767ccf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:40.106766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1285/2573] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:39 2022] DELETE /identity/v3/users/cd63d7077bfc4ca69038190cf6767ccf => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:40.111437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:40.111923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:40.112060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:40.129542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:40.131236 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:40.196768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1289/2574] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:40.206356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:40.207850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:40.274194 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18514b7-d7de-46ff-892d-d52673a6cbbd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:40.277839 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:40.278485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:40.278767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:40.279048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:40.288369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:40.289797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:40.299143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1286/2575] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:40.704829 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:40.706380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:40.720100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378661-6842-4fd1-a1d9-84a85ec8db26 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:40.725922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:40.726790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:40.727073 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:40.727488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] PATH_INFO: `/v3/projects/d7dbb3f9d2464b429fd610a830d5954c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:40.728726 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dbb3f9d2464b429fd610a830d5954c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:40.730742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:40.882009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dbb3f9d2464b429fd610a830d5954c', 'request_id': 'req-50a83da9-8c58-4f52-bdf8-ba520153662b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:40.946480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dbb3f9d2464b429fd610a830d5954c', 'request_id': 'req-50a83da9-8c58-4f52-bdf8-ba520153662b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:40.956653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dbb3f9d2464b429fd610a830d5954c', 'request_id': 'req-50a83da9-8c58-4f52-bdf8-ba520153662b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:40.964817 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] The token cache is being invalidate because project d7dbb3f9d2464b429fd610a830d5954c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:40.965104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:40.965756 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:40.967336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1290/2576] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:40 2022] DELETE /identity/v3/projects/d7dbb3f9d2464b429fd610a830d5954c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:40.971442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:40.981857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ce08-06a4-42ae-a9ab-8953cb99bd4e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:41.001284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:41.042387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:41.045163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:41.045163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:41.045163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] PATH_INFO: `/v3/users/02f527b9a5d64c87a9cb06cd4e638556` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:41.045163 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f527b9a5d64c87a9cb06cd4e638556)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:41.047108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:41.338062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f527b9a5d64c87a9cb06cd4e638556'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:41.349719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f527b9a5d64c87a9cb06cd4e638556'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:41.356755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f527b9a5d64c87a9cb06cd4e638556'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:41.357542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f527b9a5d64c87a9cb06cd4e638556'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:41.443151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2ebd560-89fb-46d6-8b11-96d9b102f347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f527b9a5d64c87a9cb06cd4e638556'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:41.449804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1287/2577] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:40 2022] DELETE /identity/v3/users/02f527b9a5d64c87a9cb06cd4e638556 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:42.108930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:42.110485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:42.125935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a83da9-8c58-4f52-bdf8-ba520153662b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:42.186201 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:42.187053 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:42.187332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:42.187605 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] PATH_INFO: `/v3/projects/92841c5e3aa3474aade7113e09720dd9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:42.188826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92841c5e3aa3474aade7113e09720dd9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:42.190717 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:42.339628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:42.357016 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92841c5e3aa3474aade7113e09720dd9', 'request_id': 'req-cbd38adc-8368-4c52-b880-20c43e4d7a0a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:42.463960 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92841c5e3aa3474aade7113e09720dd9', 'request_id': 'req-cbd38adc-8368-4c52-b880-20c43e4d7a0a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:42.470721 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92841c5e3aa3474aade7113e09720dd9', 'request_id': 'req-cbd38adc-8368-4c52-b880-20c43e4d7a0a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:42.481651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] The token cache is being invalidate because project 92841c5e3aa3474aade7113e09720dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:42.481938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:42.482613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd38adc-8368-4c52-b880-20c43e4d7a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:42.484281 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1291/2578] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:42 2022] DELETE /identity/v3/projects/92841c5e3aa3474aade7113e09720dd9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:42.491096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b719a7-de4a-4964-a8d4-52501d5ddcdb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:42.491608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b719a7-de4a-4964-a8d4-52501d5ddcdb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:42.491718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b719a7-de4a-4964-a8d4-52501d5ddcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:42.512488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-43b719a7-de4a-4964-a8d4-52501d5ddcdb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:42.513742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-43b719a7-de4a-4964-a8d4-52501d5ddcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:42.574106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1288/2579] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:42.584576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8dfef-780f-412a-8bbf-0279251571be None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:42.584762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8dfef-780f-412a-8bbf-0279251571be None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:42.584965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8dfef-780f-412a-8bbf-0279251571be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:42.603039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b7f8dfef-780f-412a-8bbf-0279251571be None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:42.604254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b7f8dfef-780f-412a-8bbf-0279251571be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:42.612496 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1292/2580] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:42.617298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b719a7-de4a-4964-a8d4-52501d5ddcdb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:42.627021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b719a7-de4a-4964-a8d4-52501d5ddcdb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:42.636301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:42.636301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:42.636301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:42.636301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:42.636836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:42.636836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:42.636836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:42.648318 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1289/2581] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:26:42.652919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8dfef-780f-412a-8bbf-0279251571be None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:42.663183 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8dfef-780f-412a-8bbf-0279251571be None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:42.670602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:42.670602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:42.670602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:42.670602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:42.671036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:42.672086 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:42.815598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1293/2582] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:42 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:42.816834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:42.828491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cb7f1-8d83-404f-9766-745eb3b90f01 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:42.854659 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:42.886063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:42.886707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:42.887124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:42.887405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:42.888089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:42.890036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:42.987095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1290/2583] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:42 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:42.991371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:43.002024 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3303ec-085a-44fb-8b5d-f7d616dcab2f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:43.008100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:43.008787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:43.009069 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:43.009343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:43.010067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:43.011935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:43.024388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1294/2584] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:43.028390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:43.038865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd99a5-3583-4df1-924b-d3f5ee5613c8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:43.043750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bf83c-250d-412e-8dc4-b430a6b51afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:43.044454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bf83c-250d-412e-8dc4-b430a6b51afc admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:43.044910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bf83c-250d-412e-8dc4-b430a6b51afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:43.045233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bf83c-250d-412e-8dc4-b430a6b51afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:43.045976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bf83c-250d-412e-8dc4-b430a6b51afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:43.047655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bf83c-250d-412e-8dc4-b430a6b51afc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:43.059569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1291/2585] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:43.063720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:43.074497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504d702-7812-4aba-b5b2-6925322a3bc0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:43.079406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:43.080365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:43.080654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:43.080933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] PATH_INFO: `/v3/projects/bca9c08c3b004958b5c3baba4d377280/users/17b54f03f2e24e1c8b55fa7b0de39fd5/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:43.096174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca9c08c3b004958b5c3baba4d377280, user_id=17b54f03f2e24e1c8b55fa7b0de39fd5, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:43.098996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:43.252696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1295/2586] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:43 2022] PUT /identity/v3/projects/bca9c08c3b004958b5c3baba4d377280/users/17b54f03f2e24e1c8b55fa7b0de39fd5/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:43.264894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:43.265308 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:43.265574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:43.292387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] MFA Rules not processed for user `17b54f03f2e24e1c8b55fa7b0de39fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:43.293577 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:43.360086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1292/2587] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:43.371923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:43.373749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:43.431399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f132dd-553f-4bab-b393-04e063766f41 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:43.435826 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e3ffe-cd2f-49c7-8c95-04a25d66486b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:43.436527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3ffe-cd2f-49c7-8c95-04a25d66486b service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:43.436825 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3ffe-cd2f-49c7-8c95-04a25d66486b service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:43.437101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3ffe-cd2f-49c7-8c95-04a25d66486b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:43.446418 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e3ffe-cd2f-49c7-8c95-04a25d66486b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:43.448013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e3ffe-cd2f-49c7-8c95-04a25d66486b service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:43.460548 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1296/2588] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:43.791475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:43.792913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:43.856257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b339-09ac-43e8-8128-1eb974676eac None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:43.860771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:43.861632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:43.861915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:43.862190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] PATH_INFO: `/v3/users/333e532906f54fcd88635c4bd1959086` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:43.863402 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333e532906f54fcd88635c4bd1959086)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:43.865386 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:44.053789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333e532906f54fcd88635c4bd1959086'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:44.065514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333e532906f54fcd88635c4bd1959086'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:44.072499 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:44.075385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333e532906f54fcd88635c4bd1959086'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:44.076118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333e532906f54fcd88635c4bd1959086'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:44.206648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333e532906f54fcd88635c4bd1959086'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:44.216829 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1293/2589] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:43 2022] DELETE /identity/v3/users/333e532906f54fcd88635c4bd1959086 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:44.221181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:44.223730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:44.223730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:44.263815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:44.265067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:44.329194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:44.342732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1297/2590] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:44.352691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:44.354553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:44.416694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36818b4-5501-4a74-b2b4-157506c0c302 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:44.420665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:44.421340 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:44.421626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:44.421903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:44.431764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:44.434792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:44.444487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1294/2591] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:44.929364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:44.932364 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:44.951101 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e2340-4d8c-4d65-86e9-31d25fd40ebe None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:44.958447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:44.960432 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:44.960912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:44.961389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] PATH_INFO: `/v3/projects/0c9a316673a24516859ac845da3db5f5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:44.963090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9a316673a24516859ac845da3db5f5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:44.965387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:45.096504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9a316673a24516859ac845da3db5f5', 'request_id': 'req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.209654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9a316673a24516859ac845da3db5f5', 'request_id': 'req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.216815 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9a316673a24516859ac845da3db5f5', 'request_id': 'req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.228695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] The token cache is being invalidate because project 0c9a316673a24516859ac845da3db5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:45.230342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.230342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.231227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1298/2592] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:44 2022] DELETE /identity/v3/projects/0c9a316673a24516859ac845da3db5f5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:45.235229 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:45.245039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586021e6-8d4c-4845-afc3-27f9a8c370f7 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:45.306139 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:45.306929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:45.307208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:45.307480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] PATH_INFO: `/v3/users/5cbe8381ba654af48dbd6b5bfc43f3ea` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:45.308693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbe8381ba654af48dbd6b5bfc43f3ea)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:45.310974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:45.595460 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbe8381ba654af48dbd6b5bfc43f3ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.605353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:45.607502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbe8381ba654af48dbd6b5bfc43f3ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.614170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbe8381ba654af48dbd6b5bfc43f3ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.618060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbe8381ba654af48dbd6b5bfc43f3ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.709038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6e7f073b-67a1-4b33-a099-a0a9ff5c6d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbe8381ba654af48dbd6b5bfc43f3ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:45.715651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1295/2593] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:45 2022] DELETE /identity/v3/users/5cbe8381ba654af48dbd6b5bfc43f3ea => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:46.231226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:46.232719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:46.246429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3c602-dec4-48f2-8271-70b4e4ef7dc2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:46.315714 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:46.316736 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:46.317015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:46.317285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] PATH_INFO: `/v3/projects/b0a7b93f0bdf4d71b6e89ea6eab98b59` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:46.319683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a7b93f0bdf4d71b6e89ea6eab98b59)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:46.321766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:46.436961 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a7b93f0bdf4d71b6e89ea6eab98b59', 'request_id': 'req-07a2b01d-56d5-4096-a5d2-5d85ff871504'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:46.505851 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a7b93f0bdf4d71b6e89ea6eab98b59', 'request_id': 'req-07a2b01d-56d5-4096-a5d2-5d85ff871504'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:46.513042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a7b93f0bdf4d71b6e89ea6eab98b59', 'request_id': 'req-07a2b01d-56d5-4096-a5d2-5d85ff871504'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:46.524753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] The token cache is being invalidate because project b0a7b93f0bdf4d71b6e89ea6eab98b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:46.525046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:46.525700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-07a2b01d-56d5-4096-a5d2-5d85ff871504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:46.527783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1299/2594] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:46 2022] DELETE /identity/v3/projects/b0a7b93f0bdf4d71b6e89ea6eab98b59 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:46.532282 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33cea-50d3-4e22-bb85-2dac04b0d0a1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:46.532790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33cea-50d3-4e22-bb85-2dac04b0d0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:46.532896 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33cea-50d3-4e22-bb85-2dac04b0d0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:46.551723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5eb33cea-50d3-4e22-bb85-2dac04b0d0a1 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:46.552951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5eb33cea-50d3-4e22-bb85-2dac04b0d0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:46.621909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1296/2595] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:46.631413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a7160-bedf-4753-9b87-56ad5639f9d2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:46.631710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a7160-bedf-4753-9b87-56ad5639f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:46.632029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a7160-bedf-4753-9b87-56ad5639f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:46.645193 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:46.651276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8f6a7160-bedf-4753-9b87-56ad5639f9d2 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:46.652517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8f6a7160-bedf-4753-9b87-56ad5639f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:46.660522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1300/2596] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:46.665691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb33cea-50d3-4e22-bb85-2dac04b0d0a1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:46.676052 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb33cea-50d3-4e22-bb85-2dac04b0d0a1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:46.685315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:46.685315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:46.685315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:46.685315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:46.685731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:46.685731 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:46.685917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:46.702130 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1297/2597] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:26:46.703330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a7160-bedf-4753-9b87-56ad5639f9d2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:46.714141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a7160-bedf-4753-9b87-56ad5639f9d2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:46.718935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:46.725151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:46.725151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:46.725151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:46.725151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:46.725151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:46.816187 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1301/2598] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:46 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:46.821269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:46.831186 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c4aa-e83c-4732-a968-568a76daac2f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:46.890064 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:46.890730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:46.894607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:46.894607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:46.894607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:46.894607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:46.992005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1298/2599] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:46 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:46.995622 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.006617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984801-93e4-46a8-a3b9-f74e337d5c45 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.011437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.012119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.012433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.012711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.013433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:47.015115 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:47.026266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1302/2600] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:47.030348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.040431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38019f5-26a2-4d06-bad3-426884a9467b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.045013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb7893-c102-4ddb-bec3-b7fe14686d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.045666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb7893-c102-4ddb-bec3-b7fe14686d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.045944 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb7893-c102-4ddb-bec3-b7fe14686d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.046217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb7893-c102-4ddb-bec3-b7fe14686d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.046933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb7893-c102-4ddb-bec3-b7fe14686d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:47.048545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb7893-c102-4ddb-bec3-b7fe14686d2c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:47.058439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1299/2601] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:47.062783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.073487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3bae6-2ab3-40ab-a9e5-532f31c13ed1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.078227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.079131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.079411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.079685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] PATH_INFO: `/v3/projects/d7e0dca04a9d4f30b7931cfd38661627/users/5beaeebb09734f3880674b945b9c0cd2/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.095109 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e0dca04a9d4f30b7931cfd38661627, user_id=5beaeebb09734f3880674b945b9c0cd2, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:47.099810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:47.280602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1303/2602] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:47 2022] PUT /identity/v3/projects/d7e0dca04a9d4f30b7931cfd38661627/users/5beaeebb09734f3880674b945b9c0cd2/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:47.291072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd995-1c4e-4b8f-bb4d-b630556e923b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.291361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd995-1c4e-4b8f-bb4d-b630556e923b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.291639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd995-1c4e-4b8f-bb4d-b630556e923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.318809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-922fd995-1c4e-4b8f-bb4d-b630556e923b None None] MFA Rules not processed for user `5beaeebb09734f3880674b945b9c0cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:47.323137 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-922fd995-1c4e-4b8f-bb4d-b630556e923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:47.351203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:47.383635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1300/2603] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:47.388117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.450004 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf08551-cfba-480d-bd2a-dfd7464bf8f7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.454678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.455328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.455611 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.455890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.456648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:47.458555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:47.564272 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1304/2604] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:47 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:47.569093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd995-1c4e-4b8f-bb4d-b630556e923b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.579673 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd995-1c4e-4b8f-bb4d-b630556e923b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.637872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.638920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.638920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.639107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.639755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:47.641780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:47.781099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1301/2605] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:47 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:47.785038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.795266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36fed-2217-4147-8ee3-409b3f017c34 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.800006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.800707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.800979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.801256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.801979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:47.803835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:47.814534 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1305/2606] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:47.819166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.829199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286eb7-9d21-4144-b21e-2e093f7bcd23 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.834310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.840178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.840178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:47.840178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] PATH_INFO: `/v3/projects/766ecbcc908e438aa520d8ca0312fc9d/users/40d275e4e46d497c934fbbe158369ae4/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:47.850231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766ecbcc908e438aa520d8ca0312fc9d, user_id=40d275e4e46d497c934fbbe158369ae4, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:47.852998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:47.921610 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1302/2607] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:47 2022] PUT /identity/v3/projects/766ecbcc908e438aa520d8ca0312fc9d/users/40d275e4e46d497c934fbbe158369ae4/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:47.929729 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:47.940275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b261a-5fe7-479e-aba5-eaddd5d17b60 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:47.998881 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9c2eb-e712-4a86-99e6-e89b4f6d910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:47.999542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c2eb-e712-4a86-99e6-e89b4f6d910f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:47.999824 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c2eb-e712-4a86-99e6-e89b4f6d910f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:48.000096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c2eb-e712-4a86-99e6-e89b4f6d910f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:48.000853 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9c2eb-e712-4a86-99e6-e89b4f6d910f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:48.002509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9c2eb-e712-4a86-99e6-e89b4f6d910f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:48.016844 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1306/2608] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:48.018312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:48.030279 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701d44c-c29a-4826-a8d5-579550143392 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:48.035228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:48.036272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:48.036555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:48.036881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] PATH_INFO: `/v3/projects/766ecbcc908e438aa520d8ca0312fc9d/users/40d275e4e46d497c934fbbe158369ae4/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:48.040030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766ecbcc908e438aa520d8ca0312fc9d, user_id=40d275e4e46d497c934fbbe158369ae4, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:48.042739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:48.054286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1303/2609] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:48 2022] PUT /identity/v3/projects/766ecbcc908e438aa520d8ca0312fc9d/users/40d275e4e46d497c934fbbe158369ae4/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:48.067202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c21b8-ed91-4251-be88-ec166fdb92f3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:48.067508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c21b8-ed91-4251-be88-ec166fdb92f3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:48.067766 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c21b8-ed91-4251-be88-ec166fdb92f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:48.093158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:48.096569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-297c21b8-ed91-4251-be88-ec166fdb92f3 None None] MFA Rules not processed for user `40d275e4e46d497c934fbbe158369ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:48.097778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-297c21b8-ed91-4251-be88-ec166fdb92f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:48.170131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1307/2610] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:48.181502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:48.183468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:48.242365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd800b8d-b56c-4e6d-b85b-8cd1bf4db169 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:48.245926 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5747b-0ce4-4831-9e8c-3ceb8140e365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:48.246560 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5747b-0ce4-4831-9e8c-3ceb8140e365 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:48.246840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5747b-0ce4-4831-9e8c-3ceb8140e365 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:48.247114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5747b-0ce4-4831-9e8c-3ceb8140e365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:48.257463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5747b-0ce4-4831-9e8c-3ceb8140e365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:48.258888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5747b-0ce4-4831-9e8c-3ceb8140e365 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:48.268483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1304/2611] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:48.297916 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c21b8-ed91-4251-be88-ec166fdb92f3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:48.361288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c21b8-ed91-4251-be88-ec166fdb92f3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:48.365919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:48.366787 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:48.367065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:48.367366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] PATH_INFO: `/v3/users/5beaeebb09734f3880674b945b9c0cd2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:48.368573 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5beaeebb09734f3880674b945b9c0cd2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:48.370471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:48.545249 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5beaeebb09734f3880674b945b9c0cd2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:48.551967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5beaeebb09734f3880674b945b9c0cd2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:48.552670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5beaeebb09734f3880674b945b9c0cd2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:48.553454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5beaeebb09734f3880674b945b9c0cd2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:48.565468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5beaeebb09734f3880674b945b9c0cd2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:48.683429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1308/2612] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:48 2022] DELETE /identity/v3/users/5beaeebb09734f3880674b945b9c0cd2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:48.688135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:48.693008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:48.693008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:48.707211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:48.708439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:48.732787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:48.772909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1305/2613] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:48.782084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:48.794623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:48.804292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:48.842980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4fcfc-26ce-4b14-bcb9-87a555bc07e6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:48.846627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:48.847299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:48.848099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:48.848099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:48.857450 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:48.859039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:48.869472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1309/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:49.337042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:49.338695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:49.352898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83461a60-941f-4d0b-81af-601316c01a6a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:49.357903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:49.358757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:49.359034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:49.359307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] PATH_INFO: `/v3/projects/d7e0dca04a9d4f30b7931cfd38661627` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:49.360513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e0dca04a9d4f30b7931cfd38661627)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:49.362451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:49.526967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e0dca04a9d4f30b7931cfd38661627', 'request_id': 'req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:49.533026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e0dca04a9d4f30b7931cfd38661627', 'request_id': 'req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:49.669178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e0dca04a9d4f30b7931cfd38661627', 'request_id': 'req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:49.681823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] The token cache is being invalidate because project d7e0dca04a9d4f30b7931cfd38661627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:49.682112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:49.682769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:49.684603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1306/2615] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:49 2022] DELETE /identity/v3/projects/d7e0dca04a9d4f30b7931cfd38661627 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:49.688604 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:49.699506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180448d-7545-4861-adb9-cb4b78feb23f service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:49.760065 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:49.760953 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:49.761233 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:49.761507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] PATH_INFO: `/v3/users/40d275e4e46d497c934fbbe158369ae4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:49.762675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d275e4e46d497c934fbbe158369ae4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:49.764623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:50.035524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d275e4e46d497c934fbbe158369ae4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.048683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d275e4e46d497c934fbbe158369ae4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.048683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d275e4e46d497c934fbbe158369ae4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.048683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d275e4e46d497c934fbbe158369ae4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.058591 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5ce55506-c124-4d4b-9ad2-bd880791a5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d275e4e46d497c934fbbe158369ae4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.197276 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1310/2616] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:49 2022] DELETE /identity/v3/users/40d275e4e46d497c934fbbe158369ae4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:50.650891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:50.652418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:50.667636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deeb76-e7b9-4946-bafb-d96a92bf6ee2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:50.727939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:50.728828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:50.729107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:50.729383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] PATH_INFO: `/v3/projects/766ecbcc908e438aa520d8ca0312fc9d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:50.730586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=766ecbcc908e438aa520d8ca0312fc9d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:50.732511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:50.837492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766ecbcc908e438aa520d8ca0312fc9d', 'request_id': 'req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.842648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:50.843858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766ecbcc908e438aa520d8ca0312fc9d', 'request_id': 'req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.935268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766ecbcc908e438aa520d8ca0312fc9d', 'request_id': 'req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.948665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] The token cache is being invalidate because project 766ecbcc908e438aa520d8ca0312fc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:50.948959 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.949611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-95fd8ab5-0abd-4508-9ff9-e1cc81a30bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:50.951343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1307/2617] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:50 2022] DELETE /identity/v3/projects/766ecbcc908e438aa520d8ca0312fc9d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:50.955955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5658e7-35a4-40e1-8295-4d884a1388fd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:50.956482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5658e7-35a4-40e1-8295-4d884a1388fd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:50.956575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5658e7-35a4-40e1-8295-4d884a1388fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:50.975840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1b5658e7-35a4-40e1-8295-4d884a1388fd None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:50.977090 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1b5658e7-35a4-40e1-8295-4d884a1388fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:51.011430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:51.036800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1311/2618] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:51.046432 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62e66-f7ca-46d6-ab1b-abd4e53c0efa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.046723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62e66-f7ca-46d6-ab1b-abd4e53c0efa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.047062 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62e66-f7ca-46d6-ab1b-abd4e53c0efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.065481 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-37e62e66-f7ca-46d6-ab1b-abd4e53c0efa None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:51.070382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37e62e66-f7ca-46d6-ab1b-abd4e53c0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:51.077943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1308/2619] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:51.082207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5658e7-35a4-40e1-8295-4d884a1388fd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.092955 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5658e7-35a4-40e1-8295-4d884a1388fd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.101767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.101767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.101767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.101767 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.102601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:51.102601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.104847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:51.125165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1312/2620] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:26:51.130133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62e66-f7ca-46d6-ab1b-abd4e53c0efa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.136346 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62e66-f7ca-46d6-ab1b-abd4e53c0efa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.141701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.142381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.142660 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.142952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.143778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.145883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:51.266191 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1309/2621] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:51 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:51.270235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.282147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372224be-06a5-41e9-a21b-2050bf812e6e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.340549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.341207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.341488 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.341765 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.342446 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.344408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:51.452139 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1313/2622] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:51 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:51.456265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.467643 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04098862-b52f-4ea4-8a10-18c94c77318a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.472280 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.472957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.478807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.478807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.478807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.478807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:51.487639 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1310/2623] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:51.491704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.501799 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62aebf-3bc2-483a-9c38-9049c9636bbc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.506944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd5714-c3f5-4003-8ca1-b19162a6e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.507789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd5714-c3f5-4003-8ca1-b19162a6e95e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.508072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd5714-c3f5-4003-8ca1-b19162a6e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.508380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd5714-c3f5-4003-8ca1-b19162a6e95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.509102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd5714-c3f5-4003-8ca1-b19162a6e95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.510681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd5714-c3f5-4003-8ca1-b19162a6e95e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:51.520603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1314/2624] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:51.525291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.535276 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258e3b0-2562-434b-b9e8-f7df8ea9f313 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.540554 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.541418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.541700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.542003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] PATH_INFO: `/v3/projects/f07d0d2555684c71a9afada9e28f73d1/users/fe666d23c9da44ed962bacf49e543086/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.557118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07d0d2555684c71a9afada9e28f73d1, user_id=fe666d23c9da44ed962bacf49e543086, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.560040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:51.632113 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1311/2625] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:51 2022] PUT /identity/v3/projects/f07d0d2555684c71a9afada9e28f73d1/users/fe666d23c9da44ed962bacf49e543086/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:51.642553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af133c-a79f-4121-b763-dd56567dcb7c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.642841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af133c-a79f-4121-b763-dd56567dcb7c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.643117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af133c-a79f-4121-b763-dd56567dcb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.670884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-33af133c-a79f-4121-b763-dd56567dcb7c None None] MFA Rules not processed for user `fe666d23c9da44ed962bacf49e543086`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:51.672021 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-33af133c-a79f-4121-b763-dd56567dcb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:51.734430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1315/2626] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:51.739019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.800217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec807ae-5104-461e-bcea-6a219787bcb4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.804919 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.805567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.805844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.806119 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.806809 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.808733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:51.906045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1312/2627] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:51 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:26:51.910171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af133c-a79f-4121-b763-dd56567dcb7c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:51.921489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af133c-a79f-4121-b763-dd56567dcb7c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:51.956158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:51.980771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:51.981431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:51.981711 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:51.981984 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:51.982655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:51.984623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:52.083757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1316/2628] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:51 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:52.088397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:52.099165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554832-db83-4df6-8e72-e720fdd2aec8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:52.103988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:52.104696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.104978 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.105254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.105981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:52.107564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:52.118622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1313/2629] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:52.122697 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:52.133330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267740f0-67ea-4dcf-8cc2-3b2244d8d5cb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:52.138465 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd76e-e23b-458b-b892-80959c441a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:52.139132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd76e-e23b-458b-b892-80959c441a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.139417 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd76e-e23b-458b-b892-80959c441a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.139695 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd76e-e23b-458b-b892-80959c441a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.140498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd76e-e23b-458b-b892-80959c441a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:52.142124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd76e-e23b-458b-b892-80959c441a1b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:52.152923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1317/2630] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:26:52.156897 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:52.167050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fc48e-b526-4154-8c31-a2437257d99a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:52.171741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:52.172638 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.172935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.173216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] PATH_INFO: `/v3/projects/173c0fce47de4875a98a9b7fe4c29928/users/ecff27dd3043448d8f43e5ad60b94895/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.188331 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173c0fce47de4875a98a9b7fe4c29928, user_id=ecff27dd3043448d8f43e5ad60b94895, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:52.191036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:52.258420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1314/2631] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:52 2022] PUT /identity/v3/projects/173c0fce47de4875a98a9b7fe4c29928/users/ecff27dd3043448d8f43e5ad60b94895/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:52.268594 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1355-4347-48ec-94e1-a64e7872c575 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.268889 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1355-4347-48ec-94e1-a64e7872c575 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.269178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1355-4347-48ec-94e1-a64e7872c575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.297314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-abbb1355-4347-48ec-94e1-a64e7872c575 None None] MFA Rules not processed for user `ecff27dd3043448d8f43e5ad60b94895`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:52.298561 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-abbb1355-4347-48ec-94e1-a64e7872c575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:52.373027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1318/2632] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:52.377670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:52.411984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:52.459795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48092b09-cd40-477b-bcfc-4f02cb12d448 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:52.464686 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:52.469716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.469716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.469716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.469716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:52.469716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:52.589699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1315/2633] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:52 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:52.593723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1355-4347-48ec-94e1-a64e7872c575 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:52.605120 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1355-4347-48ec-94e1-a64e7872c575 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:52.659748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:52.660444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.660723 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.660993 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.661684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:52.664217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:52.827194 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1319/2634] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:52 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:52.831063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:52.841385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b59578-0a3a-48fa-bb56-b8bede53b4a0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:52.845967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:52.846617 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.846900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.847486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.847903 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:52.849621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:52.862785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1316/2635] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:52.867477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:52.878651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed694-78a9-4ece-9f97-1ced4160afb7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:52.888722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:52.889745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:52.890123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:52.890854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] PATH_INFO: `/v3/projects/990caeae9ece476187be8e5927909f84/users/6b0e5b7940d44a12962914ecef6ee0dc/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:52.908027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990caeae9ece476187be8e5927909f84, user_id=6b0e5b7940d44a12962914ecef6ee0dc, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:52.911172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:53.017485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1320/2636] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:52 2022] PUT /identity/v3/projects/990caeae9ece476187be8e5927909f84/users/6b0e5b7940d44a12962914ecef6ee0dc/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:53.021213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:53.031869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e47bb-ff57-42ec-883e-0ef102370e12 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:53.092446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008dbb-6655-4f5e-9ca3-9a813e15e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:53.093321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008dbb-6655-4f5e-9ca3-9a813e15e07d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:53.093608 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008dbb-6655-4f5e-9ca3-9a813e15e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:53.093891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008dbb-6655-4f5e-9ca3-9a813e15e07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:53.094618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008dbb-6655-4f5e-9ca3-9a813e15e07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:53.096269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008dbb-6655-4f5e-9ca3-9a813e15e07d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:53.106921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1317/2637] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:53.111107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:53.121806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d42750-c991-49fe-9e82-76b3e1818da5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:53.126375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:53.127332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:53.127753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:53.128136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] PATH_INFO: `/v3/projects/990caeae9ece476187be8e5927909f84/users/6b0e5b7940d44a12962914ecef6ee0dc/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:53.130160 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] RBAC: Authorizing `identity:create_grant(project_id=990caeae9ece476187be8e5927909f84, user_id=6b0e5b7940d44a12962914ecef6ee0dc, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:53.132986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:53.136859 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:53.145458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1321/2638] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:53 2022] PUT /identity/v3/projects/990caeae9ece476187be8e5927909f84/users/6b0e5b7940d44a12962914ecef6ee0dc/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:53.157387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:53.157672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:53.158019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:53.186970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] MFA Rules not processed for user `6b0e5b7940d44a12962914ecef6ee0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:53.188480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:53.266828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1318/2639] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:53.278820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:53.281352 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:53.343012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44779fc-2abb-440e-b4a5-c5c678d548be admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:53.346713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:53.347354 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:53.347635 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:53.347910 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:53.405171 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:53.406619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:53.416071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1322/2640] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:54.798321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:54.799710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:54.830283 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:54.875750 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae553f-cac4-437e-89f4-499c68c54515 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:54.884310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:54.885188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:54.885489 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:54.885752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] PATH_INFO: `/v3/users/17b54f03f2e24e1c8b55fa7b0de39fd5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:54.887012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b54f03f2e24e1c8b55fa7b0de39fd5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:54.889207 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:55.182850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b54f03f2e24e1c8b55fa7b0de39fd5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:55.200945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b54f03f2e24e1c8b55fa7b0de39fd5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:55.202393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:55.203792 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:55.204407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b54f03f2e24e1c8b55fa7b0de39fd5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:55.205307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b54f03f2e24e1c8b55fa7b0de39fd5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:55.261018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2b5f4-8007-4fdd-8cdb-771d8d038265 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:55.264719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:55.265360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:55.265644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:55.265917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:55.267691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:55.278233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3db74c8a-bfa7-4995-a5bf-0f3c4b85904f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b54f03f2e24e1c8b55fa7b0de39fd5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:55.290369 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1319/2641] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:54 2022] DELETE /identity/v3/users/17b54f03f2e24e1c8b55fa7b0de39fd5 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:55.294579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:55.295039 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:55.295503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:55.314443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:55.315740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:55.356112 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:55.357646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:55.363839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:55.369980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1323/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:55.405321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1320/2643] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:26:55.415788 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:55.417681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:55.429134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bac02-e612-4d99-a257-4a77229f2cf9 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:55.478447 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:55.479138 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:55.479441 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:55.479738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:55.489662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:55.491153 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:55.501221 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1324/2644] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:55.596370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:55.597748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:55.650164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:55.661547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b19198-a2e7-4617-abf1-f29060859e07 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:55.666581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3425940-051f-42c9-a9e2-f9235ae432cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:55.667227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3425940-051f-42c9-a9e2-f9235ae432cd service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:55.667508 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3425940-051f-42c9-a9e2-f9235ae432cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:55.667787 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3425940-051f-42c9-a9e2-f9235ae432cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:55.669845 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c3425940-051f-42c9-a9e2-f9235ae432cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:55.735202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3425940-051f-42c9-a9e2-f9235ae432cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:55.736692 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3425940-051f-42c9-a9e2-f9235ae432cd service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:55.746024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1321/2645] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:56.156228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:56.157099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:56.178672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac659d-9525-43d9-963f-0f9c469b3617 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:56.185525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:56.186719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:56.187106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:56.187487 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] PATH_INFO: `/v3/projects/bca9c08c3b004958b5c3baba4d377280` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:56.189917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca9c08c3b004958b5c3baba4d377280)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:56.192878 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:56.393232 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca9c08c3b004958b5c3baba4d377280', 'request_id': 'req-55ced659-92df-4882-8255-410776660ce8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:56.480876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca9c08c3b004958b5c3baba4d377280', 'request_id': 'req-55ced659-92df-4882-8255-410776660ce8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:56.487785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca9c08c3b004958b5c3baba4d377280', 'request_id': 'req-55ced659-92df-4882-8255-410776660ce8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:56.498928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] The token cache is being invalidate because project bca9c08c3b004958b5c3baba4d377280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:56.499218 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:56.499874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-55ced659-92df-4882-8255-410776660ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:56.501484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1325/2646] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:56 2022] DELETE /identity/v3/projects/bca9c08c3b004958b5c3baba4d377280 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:56.507693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f363db-e74e-4a09-8b66-f21655c1b728 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:56.508168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f363db-e74e-4a09-8b66-f21655c1b728 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:56.508412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f363db-e74e-4a09-8b66-f21655c1b728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:56.528495 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f5f363db-e74e-4a09-8b66-f21655c1b728 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:56.529917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5f363db-e74e-4a09-8b66-f21655c1b728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:56.591493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1322/2647] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:56.599202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74df8-9ecc-4ed4-a183-d3c0ec28ffeb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:56.599489 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74df8-9ecc-4ed4-a183-d3c0ec28ffeb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:56.599795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74df8-9ecc-4ed4-a183-d3c0ec28ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:56.617975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7fd74df8-9ecc-4ed4-a183-d3c0ec28ffeb None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:56.619197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7fd74df8-9ecc-4ed4-a183-d3c0ec28ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:56.627208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1326/2648] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:56.632081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f363db-e74e-4a09-8b66-f21655c1b728 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:56.641570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f363db-e74e-4a09-8b66-f21655c1b728 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:56.646952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:56.648164 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:56.648484 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:56.648762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:56.649494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:26:56.649803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:56.652031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:56.668243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1323/2649] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:26:56.669745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74df8-9ecc-4ed4-a183-d3c0ec28ffeb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:56.680898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74df8-9ecc-4ed4-a183-d3c0ec28ffeb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:56.686015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:56.686779 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:56.687123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:56.687482 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:56.688184 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:56.690245 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:56.816256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1327/2650] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:56 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:56.820836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:56.830801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cb50e-16a3-4a60-a0b9-db721ceeb65e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:56.889792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:56.890492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:56.890779 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:56.891054 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:56.891823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:56.894060 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:56.982104 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1324/2651] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:56 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:56.983419 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:56.997607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb2efd-6d93-480c-adf6-b727084d645a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.004686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.005397 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.008051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.008051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.008051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.008610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.021098 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1328/2652] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:57.026171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.040268 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ec4eb-43ae-4497-b54b-54999d79b082 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.046442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f33518-4c1d-4260-ac80-f333256a192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.047315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33518-4c1d-4260-ac80-f333256a192f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.047603 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33518-4c1d-4260-ac80-f333256a192f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.047966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33518-4c1d-4260-ac80-f333256a192f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.048761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f33518-4c1d-4260-ac80-f333256a192f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.050403 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f33518-4c1d-4260-ac80-f333256a192f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.064230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1325/2653] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:26:57.067254 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.078632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34884134-1b54-426e-9e4f-09d5726c6e07 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.083710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.085384 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.085758 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.086106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] PATH_INFO: `/v3/projects/0dc4ff8a88744cc69cb8bee8bf3cbbe4/users/7d72a65be7dc42a888b39ce496ca049d/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.104633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc4ff8a88744cc69cb8bee8bf3cbbe4, user_id=7d72a65be7dc42a888b39ce496ca049d, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.107332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.200778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1329/2654] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:57 2022] PUT /identity/v3/projects/0dc4ff8a88744cc69cb8bee8bf3cbbe4/users/7d72a65be7dc42a888b39ce496ca049d/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:26:57.213877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.220019 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.220644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.233035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:57.254898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] MFA Rules not processed for user `7d72a65be7dc42a888b39ce496ca049d`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:57.256853 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:57.336595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1326/2655] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:57.337939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.366811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.369227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:57.375401 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:57.422776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb732c-0df5-4877-96a0-e83dec3a6d37 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.429755 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.430493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.430848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.431612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.432462 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.435567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.436180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fb7e9-2212-45f5-8de3-b6ff4d431c71 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.441456 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.444851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.445150 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.445433 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.447534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:57.514378 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.515859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.525777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1327/2656] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:57.614899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1330/2657] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:57.625273 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.636040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83c20b-4700-4644-93d3-3e54f3be59d3 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.706811 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.707264 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.707536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.707819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.708551 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.711265 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.788968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1328/2658] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:26:57 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:26:57.793330 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.805439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdbebe-369e-485f-9f0d-a91c5843b998 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.810892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.811568 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.811906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.812304 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.813266 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.815035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.828252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1331/2659] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:26:57.831512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.843267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53371f-47b5-4167-8208-10a6da7d46ef admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.848399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.849383 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.849693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.850786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] PATH_INFO: `/v3/projects/40cdea72e5b34c68b9a466cece7249ec/users/ec35dfa954f840ccb695638863686235/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.867821 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:57.885161 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cdea72e5b34c68b9a466cece7249ec, user_id=ec35dfa954f840ccb695638863686235, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.891225 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.902147 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:57.904010 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:57.919362 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d4e4c-5b55-4874-9f0a-c9cdba264020 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:57.924616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:57.925642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:57.925946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:57.926229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] PATH_INFO: `/v3/users/34a4e4ecf1a74c188cd0bb9fc6099f36` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:57.927691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a4e4ecf1a74c188cd0bb9fc6099f36)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:57.929965 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:57.980455 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1329/2660] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:57 2022] PUT /identity/v3/projects/40cdea72e5b34c68b9a466cece7249ec/users/ec35dfa954f840ccb695638863686235/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:57.984684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:58.054462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2228959-c648-499f-a9a6-bc702ed3a356 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:58.063711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:58.064424 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:58.064708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:58.064983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:58.066701 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:58.067325 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:58.082397 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1330/2661] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:26:58.083411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:58.095533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422dcfc2-972d-4323-84d6-64f94faff1a8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:58.109012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f738ada-2204-49cf-9d13-24b0c7ceead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:58.110184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738ada-2204-49cf-9d13-24b0c7ceead9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:58.110830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738ada-2204-49cf-9d13-24b0c7ceead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:58.110830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738ada-2204-49cf-9d13-24b0c7ceead9 admin admin] PATH_INFO: `/v3/projects/40cdea72e5b34c68b9a466cece7249ec/users/ec35dfa954f840ccb695638863686235/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:58.113330 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f738ada-2204-49cf-9d13-24b0c7ceead9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cdea72e5b34c68b9a466cece7249ec, user_id=ec35dfa954f840ccb695638863686235, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:58.116915 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f738ada-2204-49cf-9d13-24b0c7ceead9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:58.127496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1331/2662] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:26:58 2022] PUT /identity/v3/projects/40cdea72e5b34c68b9a466cece7249ec/users/ec35dfa954f840ccb695638863686235/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:58.139631 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:58.139920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:58.140221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:58.173592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] MFA Rules not processed for user `ec35dfa954f840ccb695638863686235`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:58.174953 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:58.207220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a4e4ecf1a74c188cd0bb9fc6099f36'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:58.224386 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a4e4ecf1a74c188cd0bb9fc6099f36'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:58.226925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a4e4ecf1a74c188cd0bb9fc6099f36'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:58.226925 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a4e4ecf1a74c188cd0bb9fc6099f36'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:58.243123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2dc8f8ad-d53d-4b1c-b7c1-72ed5cb71d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a4e4ecf1a74c188cd0bb9fc6099f36'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:58.267483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1332/2663] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:26:58.279958 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:58.284500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:58.309412 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:58.334795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1332/2664] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:57 2022] DELETE /identity/v3/users/34a4e4ecf1a74c188cd0bb9fc6099f36 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:58.339684 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:58.339920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:58.340228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:58.362053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2abb-ec99-47b5-8d51-e4f2aa731ac1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:58.366868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:26:58.366868 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:58.420219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:58.422002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:58.422210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:58.422488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:58.424583 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:58.432448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1333/2665] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:26:58.443633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:58.446210 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:58.461411 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:26:58.492689 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:58.494267 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:58.504786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1333/2666] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:26:58.514569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f847e-3df3-448e-aa26-ccac3c839798 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:58.518720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:58.519484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:58.519899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:58.520287 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:58.532125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:58.533745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:58.548945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1334/2667] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:26:59.083566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:59.086126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:26:59.101883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd565c-5781-473c-8536-ee0033758108 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:59.107050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:59.108140 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:59.108454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:59.108730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] PATH_INFO: `/v3/projects/1a73604375df4a07998a5cacfba82bcb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:59.110511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a73604375df4a07998a5cacfba82bcb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:59.112622 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:59.269542 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a73604375df4a07998a5cacfba82bcb', 'request_id': 'req-893ee695-b960-4ef9-add9-b1bc11bf87f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.277772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a73604375df4a07998a5cacfba82bcb', 'request_id': 'req-893ee695-b960-4ef9-add9-b1bc11bf87f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.360653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a73604375df4a07998a5cacfba82bcb', 'request_id': 'req-893ee695-b960-4ef9-add9-b1bc11bf87f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.373029 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] The token cache is being invalidate because project 1a73604375df4a07998a5cacfba82bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:26:59.373167 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.373777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.375329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1334/2668] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:26:59 2022] DELETE /identity/v3/projects/1a73604375df4a07998a5cacfba82bcb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:26:59.379167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:26:59.389127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290ad13-cb2e-4e3e-b125-7389e895cb0c service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:26:59.450332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:26:59.451226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:26:59.451525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:26:59.451784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] PATH_INFO: `/v3/users/8fbbc6de687f49fdaddc22698db6ccde` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:26:59.452995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fbbc6de687f49fdaddc22698db6ccde)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:26:59.454907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:26:59.632495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fbbc6de687f49fdaddc22698db6ccde'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.639742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fbbc6de687f49fdaddc22698db6ccde'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.640453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fbbc6de687f49fdaddc22698db6ccde'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.641197 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fbbc6de687f49fdaddc22698db6ccde'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.654335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c7b7a6c5-381d-4bea-b8a1-69ca5be7ea6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fbbc6de687f49fdaddc22698db6ccde'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:26:59.726646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1335/2669] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:26:59 2022] DELETE /identity/v3/users/8fbbc6de687f49fdaddc22698db6ccde => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:00.158345 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:00.159826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:00.178564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ee695-b960-4ef9-add9-b1bc11bf87f1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:00.188479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:00.237985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:00.238941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.239222 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.239498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] PATH_INFO: `/v3/projects/cf3099353e3246a5afadcb3d2988d6a4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.241558 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3099353e3246a5afadcb3d2988d6a4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:00.243492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:00.352660 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3099353e3246a5afadcb3d2988d6a4', 'request_id': 'req-2335e189-7a86-4c22-bc79-23d2ba365bf2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:00.358213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3099353e3246a5afadcb3d2988d6a4', 'request_id': 'req-2335e189-7a86-4c22-bc79-23d2ba365bf2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:00.436947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3099353e3246a5afadcb3d2988d6a4', 'request_id': 'req-2335e189-7a86-4c22-bc79-23d2ba365bf2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:00.449931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] The token cache is being invalidate because project cf3099353e3246a5afadcb3d2988d6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:00.450220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:00.450848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2335e189-7a86-4c22-bc79-23d2ba365bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:00.452430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1335/2670] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:00 2022] DELETE /identity/v3/projects/cf3099353e3246a5afadcb3d2988d6a4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:00.457399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48d9fb-44d5-4d9c-b232-32f1ec6b8443 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.457864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48d9fb-44d5-4d9c-b232-32f1ec6b8443 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.457987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48d9fb-44d5-4d9c-b232-32f1ec6b8443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.476631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bf48d9fb-44d5-4d9c-b232-32f1ec6b8443 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:00.482366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bf48d9fb-44d5-4d9c-b232-32f1ec6b8443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:00.504896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:00.536945 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1336/2671] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:00.545301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd146a0e-1f0c-47cb-aebe-864b6fa5f3d6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.545595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd146a0e-1f0c-47cb-aebe-864b6fa5f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.545876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd146a0e-1f0c-47cb-aebe-864b6fa5f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.565630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cd146a0e-1f0c-47cb-aebe-864b6fa5f3d6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:00.566873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cd146a0e-1f0c-47cb-aebe-864b6fa5f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:00.575623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1336/2672] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:00.580036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48d9fb-44d5-4d9c-b232-32f1ec6b8443 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:00.590803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48d9fb-44d5-4d9c-b232-32f1ec6b8443 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:00.595473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:00.596128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.596451 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.596728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.597454 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:27:00.597771 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:00.599365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:00.611830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1337/2673] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:27:00.616406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd146a0e-1f0c-47cb-aebe-864b6fa5f3d6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:00.626182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd146a0e-1f0c-47cb-aebe-864b6fa5f3d6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:00.631889 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:00.632657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.632940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.633214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.634070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:00.636000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:00.731030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1337/2674] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:00 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:00.738980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:00.749810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0e1c-641f-49a5-894d-9f8d407f55a5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:00.807760 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:00.808463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.808749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.809269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.809967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:00.811897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:00.901235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1338/2675] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:00 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:00.905571 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:00.917077 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b0785-8863-4d9a-b4fc-69d7e14300b8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:00.922447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:00.923158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.923452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.923774 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.924539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:00.926241 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:00.937851 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1338/2676] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:00.942033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:00.953099 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054fa6-bde6-41ce-8dbd-751ac66db7fa admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:00.961772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ee16-51cb-4c46-84f6-823f30393ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:00.961772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ee16-51cb-4c46-84f6-823f30393ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:00.961772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ee16-51cb-4c46-84f6-823f30393ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:00.961772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ee16-51cb-4c46-84f6-823f30393ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:00.962144 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ee16-51cb-4c46-84f6-823f30393ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:00.962600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ee16-51cb-4c46-84f6-823f30393ec9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:00.973091 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1339/2677] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:00.983269 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:00.993971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0c86-9cde-4dd4-ba7a-9ffa42c2cb13 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:00.999271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.000148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.002055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.002055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] PATH_INFO: `/v3/projects/1178c233cea34d02903f12a6ce7996c3/users/4fe67740ae724aaaa7ff278f51c5f5a7/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.016270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1178c233cea34d02903f12a6ce7996c3, user_id=4fe67740ae724aaaa7ff278f51c5f5a7, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.018934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.097882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1339/2678] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:00 2022] PUT /identity/v3/projects/1178c233cea34d02903f12a6ce7996c3/users/4fe67740ae724aaaa7ff278f51c5f5a7/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:01.113890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bae53-1125-4c37-8d6a-4e73c89b907a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.114181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bae53-1125-4c37-8d6a-4e73c89b907a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.114463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bae53-1125-4c37-8d6a-4e73c89b907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.141430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-be3bae53-1125-4c37-8d6a-4e73c89b907a None None] MFA Rules not processed for user `4fe67740ae724aaaa7ff278f51c5f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:01.142648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-be3bae53-1125-4c37-8d6a-4e73c89b907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:01.206586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1340/2679] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:01.211667 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:01.260212 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:01.281635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c017c53-431f-43b2-a28d-e65ccd415fe4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:01.286300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.286947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.287474 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.288086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.288812 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.290705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.415939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1340/2680] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:01 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:01.420077 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bae53-1125-4c37-8d6a-4e73c89b907a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:01.431803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bae53-1125-4c37-8d6a-4e73c89b907a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:01.458198 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:01.489530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.490186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.490980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.491256 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.492046 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.494043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.614754 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1341/2681] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:01 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:01.619572 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:01.629955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa22d6-bafe-4504-9cdd-22caaa56bab5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:01.635144 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.635799 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.636082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.636387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.637117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.638703 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.649621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1341/2682] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:01.654063 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:01.664428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896dc55-2f43-4ea8-9338-14c005e3d96e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:01.669041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.669896 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.670170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.670437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] PATH_INFO: `/v3/projects/d9e41390e3b64baea281ce108f3eb3d7/users/1aa37932e9de42fda0759523709dbc19/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.686205 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e41390e3b64baea281ce108f3eb3d7, user_id=1aa37932e9de42fda0759523709dbc19, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.688876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.746305 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:01.748236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:01.761151 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50d00-fdfa-4ed6-a303-de0d7531febf admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:01.765844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.767924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.767924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.767924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] PATH_INFO: `/v3/users/7d72a65be7dc42a888b39ce496ca049d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.768421 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d72a65be7dc42a888b39ce496ca049d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.770332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.795640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1342/2683] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:01 2022] PUT /identity/v3/projects/d9e41390e3b64baea281ce108f3eb3d7/users/1aa37932e9de42fda0759523709dbc19/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:01.802301 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:01.860523 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cb363-3e83-44b4-a60b-ea5e7653a896 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:01.865251 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.866506 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.866802 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.867080 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.867804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.869439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.879071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1343/2684] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:27:01.883186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:01.892762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3ef8-d8e3-4218-8bd2-661fd272bd60 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:01.897511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cebbe1-8beb-4076-8426-db39fc919240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:01.898349 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cebbe1-8beb-4076-8426-db39fc919240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.898627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cebbe1-8beb-4076-8426-db39fc919240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.898898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cebbe1-8beb-4076-8426-db39fc919240 admin admin] PATH_INFO: `/v3/projects/d9e41390e3b64baea281ce108f3eb3d7/users/1aa37932e9de42fda0759523709dbc19/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.900876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cebbe1-8beb-4076-8426-db39fc919240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e41390e3b64baea281ce108f3eb3d7, user_id=1aa37932e9de42fda0759523709dbc19, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:01.903522 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cebbe1-8beb-4076-8426-db39fc919240 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:01.914640 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1344/2685] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:01 2022] PUT /identity/v3/projects/d9e41390e3b64baea281ce108f3eb3d7/users/1aa37932e9de42fda0759523709dbc19/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:01.925497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52898028-c060-4369-9e98-646603e46131 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:01.925778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52898028-c060-4369-9e98-646603e46131 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:01.926055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52898028-c060-4369-9e98-646603e46131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:01.952749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-52898028-c060-4369-9e98-646603e46131 None None] MFA Rules not processed for user `1aa37932e9de42fda0759523709dbc19`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:01.953944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-52898028-c060-4369-9e98-646603e46131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:01.974587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d72a65be7dc42a888b39ce496ca049d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:01.987503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d72a65be7dc42a888b39ce496ca049d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:01.995859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d72a65be7dc42a888b39ce496ca049d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:01.996601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d72a65be7dc42a888b39ce496ca049d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.020584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:02.024507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1345/2686] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:02.035670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52898028-c060-4369-9e98-646603e46131 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:02.037006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-52898028-c060-4369-9e98-646603e46131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.069172 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f2ecb27e-5233-4ca8-897a-6cc9530c3773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d72a65be7dc42a888b39ce496ca049d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.077177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1342/2687] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:01 2022] DELETE /identity/v3/users/7d72a65be7dc42a888b39ce496ca049d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:02.081566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.081855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.082135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.097085 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52898028-c060-4369-9e98-646603e46131 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:02.101994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:02.102415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.148480 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:02.149127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.149410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.149923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.151762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.161937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1343/2688] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:02.172466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:02.173841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.203201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:02.217668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:02.219107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:02.229643 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1346/2689] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:27:02.233361 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af992841-a12c-42b1-b946-606ca84f17d7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:02.237842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:02.238487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.238769 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.239046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.248699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:02.250126 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:02.259543 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1344/2690] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:27:02.339772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:02.349785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.358581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31114e35-6185-49d9-a55b-bc111b34c564 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:02.363219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:02.364128 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.364466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.364738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] PATH_INFO: `/v3/users/fe666d23c9da44ed962bacf49e543086` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.366040 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe666d23c9da44ed962bacf49e543086)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:02.367951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:02.437739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:02.439141 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.452326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccb3e1-2240-4187-a00a-02ca2e1571c3 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:02.455943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:02.456699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.456981 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.457255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.460521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.529770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:02.531245 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:02.541120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1345/2691] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:02.603709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe666d23c9da44ed962bacf49e543086'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.611938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe666d23c9da44ed962bacf49e543086'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.612620 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe666d23c9da44ed962bacf49e543086'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.613225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe666d23c9da44ed962bacf49e543086'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.618072 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:02.626056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d663ec17-04f0-4830-a53b-69f24bcf4f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe666d23c9da44ed962bacf49e543086'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.692510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1347/2692] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:02 2022] DELETE /identity/v3/users/fe666d23c9da44ed962bacf49e543086 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:02.696005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:02.697494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ed04-885d-463a-af41-77270c47a461 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.697619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.697838 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ed04-885d-463a-af41-77270c47a461 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.698122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ed04-885d-463a-af41-77270c47a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.713518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7061fc-ad85-4388-bb0c-c565b9dc83cc service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:02.718791 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e653ed04-885d-463a-af41-77270c47a461 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:02.720108 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e653ed04-885d-463a-af41-77270c47a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.775595 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:02.776485 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.776765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.777035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] PATH_INFO: `/v3/projects/0dc4ff8a88744cc69cb8bee8bf3cbbe4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.778232 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc4ff8a88744cc69cb8bee8bf3cbbe4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:02.780238 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:02.791027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1348/2693] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:02.800911 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ed04-885d-463a-af41-77270c47a461 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:02.802414 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e653ed04-885d-463a-af41-77270c47a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:02.858865 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ed04-885d-463a-af41-77270c47a461 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:02.862539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:02.863181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:02.863463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:02.863740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:02.873553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:02.874981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:02.885079 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1349/2694] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:27:02.936092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc4ff8a88744cc69cb8bee8bf3cbbe4', 'request_id': 'req-04cc742b-d2f1-416b-952b-4d1c67095ce0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:02.943166 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc4ff8a88744cc69cb8bee8bf3cbbe4', 'request_id': 'req-04cc742b-d2f1-416b-952b-4d1c67095ce0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.077219 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc4ff8a88744cc69cb8bee8bf3cbbe4', 'request_id': 'req-04cc742b-d2f1-416b-952b-4d1c67095ce0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.079447 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:03.090534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] The token cache is being invalidate because project 0dc4ff8a88744cc69cb8bee8bf3cbbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:03.091053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.091835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.093841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1346/2695] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:02 2022] DELETE /identity/v3/projects/0dc4ff8a88744cc69cb8bee8bf3cbbe4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:03.097820 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:03.099261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:03.113014 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e697-566a-42e7-9a49-b990dcaeafe2 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:03.177403 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:03.179051 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:03.179181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:03.179553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] PATH_INFO: `/v3/users/ec35dfa954f840ccb695638863686235` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:03.180794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec35dfa954f840ccb695638863686235)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:03.183739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:03.207598 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:03.357107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:03.358596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:03.374107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc742b-d2f1-416b-952b-4d1c67095ce0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:03.390990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:03.390990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:03.390990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:03.390990 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] PATH_INFO: `/v3/projects/f07d0d2555684c71a9afada9e28f73d1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:03.391761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07d0d2555684c71a9afada9e28f73d1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:03.391761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:03.450327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec35dfa954f840ccb695638863686235'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.457873 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec35dfa954f840ccb695638863686235'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.458533 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec35dfa954f840ccb695638863686235'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.459152 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec35dfa954f840ccb695638863686235'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.471333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec35dfa954f840ccb695638863686235'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.533861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07d0d2555684c71a9afada9e28f73d1', 'request_id': 'req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.540170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07d0d2555684c71a9afada9e28f73d1', 'request_id': 'req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.614031 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1350/2696] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:03 2022] DELETE /identity/v3/users/ec35dfa954f840ccb695638863686235 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:03.694584 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07d0d2555684c71a9afada9e28f73d1', 'request_id': 'req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.707967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] The token cache is being invalidate because project f07d0d2555684c71a9afada9e28f73d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:03.708271 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.708941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.711656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1347/2697] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:03 2022] DELETE /identity/v3/projects/f07d0d2555684c71a9afada9e28f73d1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:03.715883 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:03.717220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:03.782810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662415-2f99-4678-9d3f-e4a1287cd8eb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:03.789071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:03.789939 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:03.790225 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:03.790498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] PATH_INFO: `/v3/users/ecff27dd3043448d8f43e5ad60b94895` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:03.791694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecff27dd3043448d8f43e5ad60b94895)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:03.793651 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:03.966357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecff27dd3043448d8f43e5ad60b94895'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.973335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecff27dd3043448d8f43e5ad60b94895'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.974041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecff27dd3043448d8f43e5ad60b94895'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.974745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecff27dd3043448d8f43e5ad60b94895'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:03.987166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e70cd3d4-31e0-4929-84a5-9894b43d1a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecff27dd3043448d8f43e5ad60b94895'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.044909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:04.047070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:04.091616 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1351/2698] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:03 2022] DELETE /identity/v3/users/ecff27dd3043448d8f43e5ad60b94895 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:04.134096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbeb2-738a-42ac-ac1b-c8375f4d4f54 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:04.211826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:04.213358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.213636 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.214315 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] PATH_INFO: `/v3/projects/40cdea72e5b34c68b9a466cece7249ec` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.215521 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cdea72e5b34c68b9a466cece7249ec)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:04.218037 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:04.309993 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:04.333688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cdea72e5b34c68b9a466cece7249ec', 'request_id': 'req-67039526-b175-4f9d-9b12-363e6c3e7f93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.341715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cdea72e5b34c68b9a466cece7249ec', 'request_id': 'req-67039526-b175-4f9d-9b12-363e6c3e7f93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.408292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cdea72e5b34c68b9a466cece7249ec', 'request_id': 'req-67039526-b175-4f9d-9b12-363e6c3e7f93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.422645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] The token cache is being invalidate because project 40cdea72e5b34c68b9a466cece7249ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:04.423171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.423888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-67039526-b175-4f9d-9b12-363e6c3e7f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.425503 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1348/2699] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:04 2022] DELETE /identity/v3/projects/40cdea72e5b34c68b9a466cece7249ec => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:04.432316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.432603 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.432900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.454471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:04.455737 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:04.468823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:04.518424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1352/2700] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:04.526201 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199008c-839e-4d1d-83db-daad6578c0b6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.526496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199008c-839e-4d1d-83db-daad6578c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.526826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199008c-839e-4d1d-83db-daad6578c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.533210 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:04.534919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:04.545967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5199008c-839e-4d1d-83db-daad6578c0b6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:04.547377 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5199008c-839e-4d1d-83db-daad6578c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:04.550746 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd677d2-f02f-4e45-bf1a-6ebc5080f417 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:04.564624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:04.564624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.564624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.564624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] PATH_INFO: `/v3/projects/173c0fce47de4875a98a9b7fe4c29928` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.565408 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=173c0fce47de4875a98a9b7fe4c29928)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:04.565677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1349/2701] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:04.565776 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:04.565867 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199008c-839e-4d1d-83db-daad6578c0b6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:04.575870 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199008c-839e-4d1d-83db-daad6578c0b6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:04.588962 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:04.589864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.589983 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.590196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.590949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:27:04.591239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:04.592905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:04.606319 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1350/2702] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:27:04.610627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:04.620780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f2c67-b73d-4e07-b9af-bd87df8ac5db admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:04.625384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:04.626007 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.626289 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.626566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.627243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:04.629154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:04.701127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173c0fce47de4875a98a9b7fe4c29928', 'request_id': 'req-c593b8f2-e953-48d0-9be1-123c1193bbab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.771203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1351/2703] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:04 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:04.772400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:04.789892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173c0fce47de4875a98a9b7fe4c29928', 'request_id': 'req-c593b8f2-e953-48d0-9be1-123c1193bbab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.799437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173c0fce47de4875a98a9b7fe4c29928', 'request_id': 'req-c593b8f2-e953-48d0-9be1-123c1193bbab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.813158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] The token cache is being invalidate because project 173c0fce47de4875a98a9b7fe4c29928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:04.813583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.814742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:04.816839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1353/2704] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:04 2022] DELETE /identity/v3/projects/173c0fce47de4875a98a9b7fe4c29928 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:04.820569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:04.821831 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:04.863031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf342-1b20-4f34-9c45-cb8f3a7ad677 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:04.869290 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:04.870042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.870427 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.870831 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.871589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:04.873618 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:04.895532 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593b8f2-e953-48d0-9be1-123c1193bbab admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:04.900847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:04.901710 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.902023 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.902261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] PATH_INFO: `/v3/users/6b0e5b7940d44a12962914ecef6ee0dc` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.903460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0e5b7940d44a12962914ecef6ee0dc)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:04.905420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:04.968302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1352/2705] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:04 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:04.972011 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:04.973678 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:04.986963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d1cdd-b450-4f96-add6-c9bdb4945421 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:04.992736 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:04.993428 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:04.993697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:04.993976 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:04.994699 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:04.996388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:05.006697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1353/2706] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:27:05.010553 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:05.020046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6961c4-dd42-4b32-b4fe-9e78df4b7975 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:05.024904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:05.025539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:05.025826 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:05.026107 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:05.026816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:05.028519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:05.039827 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1354/2707] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:27:05.044645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:05.054233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557797-2012-4174-afc6-a7bc8a4ddb77 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:05.058735 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff36106-e5e1-4749-add2-c53522bda558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:05.059844 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff36106-e5e1-4749-add2-c53522bda558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:05.060128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff36106-e5e1-4749-add2-c53522bda558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:05.060436 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff36106-e5e1-4749-add2-c53522bda558 admin admin] PATH_INFO: `/v3/projects/f65ff04528c64c91ac664da8aeed9054/users/f490ec1439f24f808d6f4f17230ce6ce/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:05.075275 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff36106-e5e1-4749-add2-c53522bda558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65ff04528c64c91ac664da8aeed9054, user_id=f490ec1439f24f808d6f4f17230ce6ce, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:05.078055 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff36106-e5e1-4749-add2-c53522bda558 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:05.135292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:05.136839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0e5b7940d44a12962914ecef6ee0dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:05.143543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0e5b7940d44a12962914ecef6ee0dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:05.144271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0e5b7940d44a12962914ecef6ee0dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:05.144875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0e5b7940d44a12962914ecef6ee0dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:05.157581 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0e5b7940d44a12962914ecef6ee0dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:05.174184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1355/2708] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:05 2022] PUT /identity/v3/projects/f65ff04528c64c91ac664da8aeed9054/users/f490ec1439f24f808d6f4f17230ce6ce/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:05.238431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:05.238627 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:05.238895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:05.249035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1354/2709] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:04 2022] DELETE /identity/v3/users/6b0e5b7940d44a12962914ecef6ee0dc => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:05.265980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] MFA Rules not processed for user `f490ec1439f24f808d6f4f17230ce6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:05.267344 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:05.273332 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:05.335045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1356/2710] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:05.346655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:05.348145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:05.406458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccc814-75dc-42f6-8b3f-dad2919dc68f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:05.410049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e20a4-a0b9-4ee4-a4c7-eb710537c6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:05.410689 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e20a4-a0b9-4ee4-a4c7-eb710537c6df service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:05.410978 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e20a4-a0b9-4ee4-a4c7-eb710537c6df service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:05.411255 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e20a4-a0b9-4ee4-a4c7-eb710537c6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:05.420413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e20a4-a0b9-4ee4-a4c7-eb710537c6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:05.421830 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e20a4-a0b9-4ee4-a4c7-eb710537c6df service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:05.430893 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1355/2711] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:05.739288 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:05.741414 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:05.822185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8d076-dd31-4938-aa1d-f8ee554926b1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:05.827178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:05.828082 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:05.828351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:05.828623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] PATH_INFO: `/v3/projects/990caeae9ece476187be8e5927909f84` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:05.829832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=990caeae9ece476187be8e5927909f84)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:05.831816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:05.995497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990caeae9ece476187be8e5927909f84', 'request_id': 'req-438e96e3-0585-4c98-ac5e-fa642843e78c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:06.000857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990caeae9ece476187be8e5927909f84', 'request_id': 'req-438e96e3-0585-4c98-ac5e-fa642843e78c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:06.074462 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990caeae9ece476187be8e5927909f84', 'request_id': 'req-438e96e3-0585-4c98-ac5e-fa642843e78c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:06.087613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] The token cache is being invalidate because project 990caeae9ece476187be8e5927909f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:06.087921 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:06.088545 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-438e96e3-0585-4c98-ac5e-fa642843e78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:06.090090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1357/2712] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:05 2022] DELETE /identity/v3/projects/990caeae9ece476187be8e5927909f84 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:06.094983 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27fae6-63ca-4d7b-9ece-ee7e80e68c51 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.095460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27fae6-63ca-4d7b-9ece-ee7e80e68c51 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.095555 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27fae6-63ca-4d7b-9ece-ee7e80e68c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.113322 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2a27fae6-63ca-4d7b-9ece-ee7e80e68c51 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:06.114509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a27fae6-63ca-4d7b-9ece-ee7e80e68c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:06.173121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1356/2713] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:06.181623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef5c06-9b89-400f-bb18-9a3de7f1162a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.181910 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef5c06-9b89-400f-bb18-9a3de7f1162a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.182193 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef5c06-9b89-400f-bb18-9a3de7f1162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.209094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d7ef5c06-9b89-400f-bb18-9a3de7f1162a None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:06.210623 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d7ef5c06-9b89-400f-bb18-9a3de7f1162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:06.226132 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1358/2714] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:06.227393 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27fae6-63ca-4d7b-9ece-ee7e80e68c51 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:06.238191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27fae6-63ca-4d7b-9ece-ee7e80e68c51 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:06.244790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:06.245583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.245930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.246273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.247291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:27:06.247666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:06.249371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:06.265656 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1357/2715] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:27:06.269899 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef5c06-9b89-400f-bb18-9a3de7f1162a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:06.279711 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef5c06-9b89-400f-bb18-9a3de7f1162a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:06.284905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:06.285564 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.285848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.286125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.286816 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:06.289579 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:06.468407 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1359/2716] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:06 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:06.472219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:06.483994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad8534-c3b8-4a1e-85a7-aab549826b4f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:06.531997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:06.541284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:06.541992 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.542278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.542556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.543239 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:06.545261 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:06.682975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1358/2717] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:06 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:06.687401 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:06.697778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cc288-9d6c-4bb8-a20b-f54dba667f23 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:06.702304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:06.702946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.703223 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.703496 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.704294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:06.705876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:06.707948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:06.718606 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1360/2718] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:06.722614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:06.733580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4cf9-3fcd-4671-a455-112039b218dc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:06.738081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70e01-9ac1-4b52-89c5-ffb7ffe65f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:06.738720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70e01-9ac1-4b52-89c5-ffb7ffe65f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.739000 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70e01-9ac1-4b52-89c5-ffb7ffe65f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.739273 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70e01-9ac1-4b52-89c5-ffb7ffe65f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.739985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70e01-9ac1-4b52-89c5-ffb7ffe65f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:06.742106 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70e01-9ac1-4b52-89c5-ffb7ffe65f64 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:06.752530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1359/2719] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:06.757203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:06.767032 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94323-8cab-4f45-8ca6-b80c9f4afb4a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:06.771532 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:06.773381 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.776954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.776954 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] PATH_INFO: `/v3/projects/3956a6034cd640b0a306b1028e855b3c/users/6dc4a76a00d447abad9e997f9efbb08d/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.789352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3956a6034cd640b0a306b1028e855b3c, user_id=6dc4a76a00d447abad9e997f9efbb08d, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:06.791941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:06.882561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1361/2720] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:06 2022] PUT /identity/v3/projects/3956a6034cd640b0a306b1028e855b3c/users/6dc4a76a00d447abad9e997f9efbb08d/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:06.893764 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f088cb-3071-479b-9893-7f50878174e9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:06.894055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f088cb-3071-479b-9893-7f50878174e9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:06.894331 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f088cb-3071-479b-9893-7f50878174e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:06.923800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f3f088cb-3071-479b-9893-7f50878174e9 None None] MFA Rules not processed for user `6dc4a76a00d447abad9e997f9efbb08d`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:06.925035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f3f088cb-3071-479b-9893-7f50878174e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:06.991935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1360/2721] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:06.996555 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:07.058058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d278876-7931-4e9e-a2e3-f54972a48f06 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:07.062951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:07.063594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:07.063875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:07.064145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:07.064841 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:07.066883 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:07.190275 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1362/2722] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:06 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:07.194900 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f088cb-3071-479b-9893-7f50878174e9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:07.205875 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f088cb-3071-479b-9893-7f50878174e9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:07.262431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:07.263082 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:07.263361 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:07.263632 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:07.264369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:07.266284 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:07.380088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1361/2723] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:07 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:07.385297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:07.395513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c5d9-22d6-4800-83ba-87f993d98eeb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:07.400352 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:07.401005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:07.401285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:07.401556 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:07.402342 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:07.403924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:07.415363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1363/2724] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:07.419076 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:07.431325 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a090e-da44-40fe-8933-9713797ebf30 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:07.436528 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5308cdb-cbd5-4afd-9104-3c02799271b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:07.437192 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5308cdb-cbd5-4afd-9104-3c02799271b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:07.437464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5308cdb-cbd5-4afd-9104-3c02799271b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:07.437735 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5308cdb-cbd5-4afd-9104-3c02799271b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:07.438463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5308cdb-cbd5-4afd-9104-3c02799271b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:07.440026 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5308cdb-cbd5-4afd-9104-3c02799271b3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:07.450863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1362/2725] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:07.466950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:07.477912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6024-04e6-4732-87bf-3d3aa46c7184 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:07.482849 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:07.483719 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:07.484002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:07.488142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] PATH_INFO: `/v3/projects/eae027dd91f4493489c9d4d7f3af3750/users/b9c119e9f5f341dbb405943114e41c02/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:07.499987 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae027dd91f4493489c9d4d7f3af3750, user_id=b9c119e9f5f341dbb405943114e41c02, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:07.502856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:07.660336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1364/2726] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:07 2022] PUT /identity/v3/projects/eae027dd91f4493489c9d4d7f3af3750/users/b9c119e9f5f341dbb405943114e41c02/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:07.671207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb2d4-106e-48e3-bb3f-22ed104cea8d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:07.671491 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb2d4-106e-48e3-bb3f-22ed104cea8d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:07.671763 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb2d4-106e-48e3-bb3f-22ed104cea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:07.701891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d3abb2d4-106e-48e3-bb3f-22ed104cea8d None None] MFA Rules not processed for user `b9c119e9f5f341dbb405943114e41c02`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:07.703038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d3abb2d4-106e-48e3-bb3f-22ed104cea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:07.734606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:07.771302 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1363/2727] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:07.775986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:07.840454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c366-04f7-4350-90f1-90c0d3f5f73a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:07.845090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:07.845823 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:07.846185 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:07.846466 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:07.847213 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:07.849138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:07.962546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1365/2728] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:07 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:07.963648 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abb2d4-106e-48e3-bb3f-22ed104cea8d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:07.974394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abb2d4-106e-48e3-bb3f-22ed104cea8d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:08.031618 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:08.032369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:08.032647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:08.032920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:08.033670 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:08.035569 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:08.134862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1364/2729] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:07 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:08.138710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:08.149100 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc319b9-4939-4c25-912a-e6ead81f3e57 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:08.153855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:08.154501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:08.154783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:08.155063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:08.155922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:08.157599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:08.160234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:08.170438 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1366/2730] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:08.174938 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:08.185928 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7778ab1-c2b5-405f-bab3-d6af7f688f65 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:08.190677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:08.191543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:08.191821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:08.192097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] PATH_INFO: `/v3/projects/33ae5a2a30154296b7d0384df1f899c6/users/638cf87269a045beb0312bc0f6221bc3/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:08.207742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ae5a2a30154296b7d0384df1f899c6, user_id=638cf87269a045beb0312bc0f6221bc3, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:08.210696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:08.338368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1365/2731] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:08 2022] PUT /identity/v3/projects/33ae5a2a30154296b7d0384df1f899c6/users/638cf87269a045beb0312bc0f6221bc3/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:08.345296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:08.355635 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7113c-fb29-4267-b9da-a986bd901f13 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:08.413892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5856e2-0774-4eb0-87ce-8ad525c09553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:08.414184 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5856e2-0774-4eb0-87ce-8ad525c09553 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:08.414437 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5856e2-0774-4eb0-87ce-8ad525c09553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:08.414721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5856e2-0774-4eb0-87ce-8ad525c09553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:08.415534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5856e2-0774-4eb0-87ce-8ad525c09553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:08.417236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5856e2-0774-4eb0-87ce-8ad525c09553 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:08.427165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1367/2732] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:08.432066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:08.442801 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b843-a346-4cef-b753-9f94de5ba881 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:08.448413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:08.449318 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:08.449600 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:08.449876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] PATH_INFO: `/v3/projects/33ae5a2a30154296b7d0384df1f899c6/users/638cf87269a045beb0312bc0f6221bc3/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:08.451864 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ae5a2a30154296b7d0384df1f899c6, user_id=638cf87269a045beb0312bc0f6221bc3, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:08.454552 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:08.464942 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1366/2733] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:08 2022] PUT /identity/v3/projects/33ae5a2a30154296b7d0384df1f899c6/users/638cf87269a045beb0312bc0f6221bc3/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:08.475162 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:08.475451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:08.476285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:08.507881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] MFA Rules not processed for user `638cf87269a045beb0312bc0f6221bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:08.507881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:08.573916 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1368/2734] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:08.587536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:08.589365 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:08.646292 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6f89-8345-42da-9a6c-e442d8d5033e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:08.650061 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:08.650694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:08.651288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:08.651288 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:08.687808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:08.710224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:08.711671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:08.720906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1367/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:10.917341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:10.918745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:10.931065 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e78082-7970-4248-8866-cdfb97245261 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:10.934846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:10.935471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:10.935749 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:10.936023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:10.993666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:10.995136 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:11.004085 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1369/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:12.889216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:12.897821 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a132b-cea3-4e5b-a0bd-d7ca29aa57b3 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:12.901920 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840a335-ed06-4ba4-9a71-4a88dc2eb1e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:12.902545 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a335-ed06-4ba4-9a71-4a88dc2eb1e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:12.902823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a335-ed06-4ba4-9a71-4a88dc2eb1e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:12.903094 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a335-ed06-4ba4-9a71-4a88dc2eb1e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:12.912009 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840a335-ed06-4ba4-9a71-4a88dc2eb1e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:12.913444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840a335-ed06-4ba4-9a71-4a88dc2eb1e9 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:12.923728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1368/2737] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:16.166681 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:16.172321 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:16.192519 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:16.241159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb49fe-fbe6-470f-a089-80cd58a4d54a service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:16.246574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:16.247443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:16.247728 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:16.248005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] PATH_INFO: `/v3/users/4fe67740ae724aaaa7ff278f51c5f5a7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:16.249286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe67740ae724aaaa7ff278f51c5f5a7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:16.251216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:16.443676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe67740ae724aaaa7ff278f51c5f5a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:16.456497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe67740ae724aaaa7ff278f51c5f5a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:16.463536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe67740ae724aaaa7ff278f51c5f5a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:16.464272 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe67740ae724aaaa7ff278f51c5f5a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:16.550400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe67740ae724aaaa7ff278f51c5f5a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:16.557099 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1370/2738] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:16 2022] DELETE /identity/v3/users/4fe67740ae724aaaa7ff278f51c5f5a7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:16.561863 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:16.562351 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:16.562460 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:16.580505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:16.581715 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:16.639642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1369/2739] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:16.649335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:16.650770 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:16.708938 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91160f05-6c3f-4939-b050-c808f87329f4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:16.713016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:16.713655 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:16.713934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:16.714204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:16.723182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:16.724626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:16.734833 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1371/2740] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:17.165683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:17.165683 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:17.178241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e010ac-ccfc-4fa0-b266-461ab468b12e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:17.182912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:17.183784 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:17.184066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:17.184629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] PATH_INFO: `/v3/projects/1178c233cea34d02903f12a6ce7996c3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:17.185832 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1178c233cea34d02903f12a6ce7996c3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:17.187748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:17.288542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1178c233cea34d02903f12a6ce7996c3', 'request_id': 'req-054c23c3-4dd0-4741-a552-12fc0941de20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.359795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1178c233cea34d02903f12a6ce7996c3', 'request_id': 'req-054c23c3-4dd0-4741-a552-12fc0941de20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.366307 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1178c233cea34d02903f12a6ce7996c3', 'request_id': 'req-054c23c3-4dd0-4741-a552-12fc0941de20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.376613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] The token cache is being invalidate because project 1178c233cea34d02903f12a6ce7996c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:17.377579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.377579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.379084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1370/2741] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:17 2022] DELETE /identity/v3/projects/1178c233cea34d02903f12a6ce7996c3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:17.383016 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:17.396079 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb8866-72ec-4d6e-b8de-9b210155497a service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:17.434479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:17.452683 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:17.453763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:17.454236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:17.454515 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] PATH_INFO: `/v3/users/1aa37932e9de42fda0759523709dbc19` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:17.456022 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa37932e9de42fda0759523709dbc19)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:17.457748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:17.639285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa37932e9de42fda0759523709dbc19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.650980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa37932e9de42fda0759523709dbc19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.658561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa37932e9de42fda0759523709dbc19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.659263 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa37932e9de42fda0759523709dbc19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.722440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-550e7ee4-3295-4388-8c13-42d4622d47ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa37932e9de42fda0759523709dbc19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:17.729109 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1372/2742] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:17 2022] DELETE /identity/v3/users/1aa37932e9de42fda0759523709dbc19 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:18.135430 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:18.137134 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:18.150222 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c23c3-4dd0-4741-a552-12fc0941de20 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:18.196394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:18.209211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:18.210059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.210336 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.210608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] PATH_INFO: `/v3/projects/d9e41390e3b64baea281ce108f3eb3d7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.211803 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e41390e3b64baea281ce108f3eb3d7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:18.213922 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:18.323947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e41390e3b64baea281ce108f3eb3d7', 'request_id': 'req-933ee26e-8794-4fb7-a201-91fbb10b0d8a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:18.396369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e41390e3b64baea281ce108f3eb3d7', 'request_id': 'req-933ee26e-8794-4fb7-a201-91fbb10b0d8a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:18.402751 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e41390e3b64baea281ce108f3eb3d7', 'request_id': 'req-933ee26e-8794-4fb7-a201-91fbb10b0d8a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:18.413208 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] The token cache is being invalidate because project d9e41390e3b64baea281ce108f3eb3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:18.413495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:18.414163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-933ee26e-8794-4fb7-a201-91fbb10b0d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:18.415742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1371/2743] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:18 2022] DELETE /identity/v3/projects/d9e41390e3b64baea281ce108f3eb3d7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:18.422507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3cd8e-ed38-4675-9151-ab5d5fdd323b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.423035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3cd8e-ed38-4675-9151-ab5d5fdd323b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.423035 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3cd8e-ed38-4675-9151-ab5d5fdd323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.441286 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e4b3cd8e-ed38-4675-9151-ab5d5fdd323b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:18.442483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e4b3cd8e-ed38-4675-9151-ab5d5fdd323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:18.500804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1373/2744] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:18.511493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb8ae-9078-46e2-96d2-aec3b53d36e2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.511833 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb8ae-9078-46e2-96d2-aec3b53d36e2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.512119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb8ae-9078-46e2-96d2-aec3b53d36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.532234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c6dcb8ae-9078-46e2-96d2-aec3b53d36e2 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:18.533463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c6dcb8ae-9078-46e2-96d2-aec3b53d36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:18.541510 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1372/2745] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:18.546420 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3cd8e-ed38-4675-9151-ab5d5fdd323b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:18.556021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3cd8e-ed38-4675-9151-ab5d5fdd323b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:18.560947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:18.561587 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.561869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.562148 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.562864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:27:18.563168 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:18.564814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:18.579797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1374/2746] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:27:18.580880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcb8ae-9078-46e2-96d2-aec3b53d36e2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:18.590794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcb8ae-9078-46e2-96d2-aec3b53d36e2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:18.595412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:18.596049 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.596360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.596634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.597332 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:18.599238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:18.672898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1373/2747] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:18 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:18.677047 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:18.687388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27e470-d5f7-437d-8dc0-9cb4b2037fe6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:18.730748 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:18.742836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:18.743497 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.743777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.744051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.744805 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:18.746882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:18.904550 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1375/2748] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:18 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:18.908731 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:18.919207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb652dd7-c63f-4a89-9d48-7665dfe5dcc1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:18.923677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:18.924360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.924641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.924921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.925700 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:18.927271 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:18.938154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1374/2749] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:18.942059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:18.952852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea552f-b9c5-439d-abf8-e5dd12424a77 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:18.957982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310cc32-7363-4650-90ea-d3c17a53797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:18.958626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310cc32-7363-4650-90ea-d3c17a53797f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.958908 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310cc32-7363-4650-90ea-d3c17a53797f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.959182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310cc32-7363-4650-90ea-d3c17a53797f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:18.959905 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310cc32-7363-4650-90ea-d3c17a53797f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:18.961525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310cc32-7363-4650-90ea-d3c17a53797f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:18.973041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1376/2750] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:18.977180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:18.987602 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a1400-eb7f-4a9c-84fc-0ea573d1b2d9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:18.992189 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:18.993089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:18.993369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:18.993645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] PATH_INFO: `/v3/projects/ddb8820ebd664d1c95a19edf46a68df4/users/2473daf0ff9c4ceaaa830285b00c6593/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:19.008740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb8820ebd664d1c95a19edf46a68df4, user_id=2473daf0ff9c4ceaaa830285b00c6593, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:19.011855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:19.111240 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1375/2751] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:18 2022] PUT /identity/v3/projects/ddb8820ebd664d1c95a19edf46a68df4/users/2473daf0ff9c4ceaaa830285b00c6593/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:19.121613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc48b-1a76-449c-84df-2b397e3b924b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:19.121902 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc48b-1a76-449c-84df-2b397e3b924b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:19.122181 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc48b-1a76-449c-84df-2b397e3b924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:19.148946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fa8bc48b-1a76-449c-84df-2b397e3b924b None None] MFA Rules not processed for user `2473daf0ff9c4ceaaa830285b00c6593`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:19.150178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fa8bc48b-1a76-449c-84df-2b397e3b924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:19.215287 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1377/2752] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:19.226525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:19.228260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:19.286238 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124145-a47f-4824-9552-0ea8fd931c90 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:19.289997 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccedf5c-d1f4-4710-be1d-a8d4010603f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:19.290634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccedf5c-d1f4-4710-be1d-a8d4010603f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:19.290917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccedf5c-d1f4-4710-be1d-a8d4010603f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:19.291195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccedf5c-d1f4-4710-be1d-a8d4010603f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:19.299410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccedf5c-d1f4-4710-be1d-a8d4010603f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:19.300931 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccedf5c-d1f4-4710-be1d-a8d4010603f5 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:19.310390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1376/2753] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:19.329817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc48b-1a76-449c-84df-2b397e3b924b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:19.392394 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc48b-1a76-449c-84df-2b397e3b924b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:19.396914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:19.397763 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:19.398043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:19.398316 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] PATH_INFO: `/v3/users/2473daf0ff9c4ceaaa830285b00c6593` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:19.399491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2473daf0ff9c4ceaaa830285b00c6593)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:19.401937 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:19.583740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2473daf0ff9c4ceaaa830285b00c6593'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:19.591707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:19.597442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2473daf0ff9c4ceaaa830285b00c6593'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:19.604793 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2473daf0ff9c4ceaaa830285b00c6593'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:19.606127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2473daf0ff9c4ceaaa830285b00c6593'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:19.719965 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2473daf0ff9c4ceaaa830285b00c6593'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:19.726408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1378/2754] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:19 2022] DELETE /identity/v3/users/2473daf0ff9c4ceaaa830285b00c6593 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:19.731867 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:19.732154 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:19.732463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:19.750180 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:19.751382 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:19.760459 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:19.817406 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1377/2755] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:19.824178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:19.826069 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:19.887154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d1980-785c-487c-a1d9-e7afccc809ac admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:19.890945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:19.891593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:19.891890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:19.892492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:19.902585 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:19.904075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:19.914359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1379/2756] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:20.416048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:20.419252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:20.433610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0035d6d-7742-44ed-bce1-501ef00bf7e8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:20.442885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:20.443752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:20.443979 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:20.444283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] PATH_INFO: `/v3/projects/ddb8820ebd664d1c95a19edf46a68df4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:20.445473 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb8820ebd664d1c95a19edf46a68df4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:20.447420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:20.586843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb8820ebd664d1c95a19edf46a68df4', 'request_id': 'req-1796550d-669e-4a87-97ff-8825e15da4cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:20.670129 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:20.671523 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:20.680777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb8820ebd664d1c95a19edf46a68df4', 'request_id': 'req-1796550d-669e-4a87-97ff-8825e15da4cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:20.685465 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d545a5c-fd83-4021-bd55-56a5cad319ab service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:20.689691 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb8820ebd664d1c95a19edf46a68df4', 'request_id': 'req-1796550d-669e-4a87-97ff-8825e15da4cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:20.709972 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] The token cache is being invalidate because project ddb8820ebd664d1c95a19edf46a68df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:20.710777 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:20.711935 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1796550d-669e-4a87-97ff-8825e15da4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:20.714783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1378/2757] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:20 2022] DELETE /identity/v3/projects/ddb8820ebd664d1c95a19edf46a68df4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:20.720567 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c981d8-8d7b-48f7-bca6-d35797167926 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:20.720673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c981d8-8d7b-48f7-bca6-d35797167926 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:20.720901 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c981d8-8d7b-48f7-bca6-d35797167926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:20.741317 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a4c981d8-8d7b-48f7-bca6-d35797167926 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:20.742195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a4c981d8-8d7b-48f7-bca6-d35797167926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:20.753291 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:20.754209 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:20.754475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:20.754777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] PATH_INFO: `/v3/users/6dc4a76a00d447abad9e997f9efbb08d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:20.755952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc4a76a00d447abad9e997f9efbb08d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:20.758111 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:20.810511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1379/2758] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:20.819096 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774be43-2305-47d7-849f-61722a366eed None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:20.819388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774be43-2305-47d7-849f-61722a366eed None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:20.819671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774be43-2305-47d7-849f-61722a366eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:20.837871 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a774be43-2305-47d7-849f-61722a366eed None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:20.839652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a774be43-2305-47d7-849f-61722a366eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:20.847666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1380/2759] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:20.851747 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774be43-2305-47d7-849f-61722a366eed None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:20.861858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774be43-2305-47d7-849f-61722a366eed None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:20.866812 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:20.868058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:20.868058 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:20.868285 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:20.868907 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:27:20.869370 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:20.871381 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:20.883150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1381/2760] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:27:20.887324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:20.897415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc6be-ca6a-4b6a-9cc7-c5f2882634c6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:20.902748 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:20.903410 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:20.903669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:20.903946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:20.904666 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:20.906556 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:20.995533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc4a76a00d447abad9e997f9efbb08d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:21.006718 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:21.012895 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc4a76a00d447abad9e997f9efbb08d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:21.014687 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1382/2761] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:20 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:21.018682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:21.021513 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc4a76a00d447abad9e997f9efbb08d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:21.022208 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc4a76a00d447abad9e997f9efbb08d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:21.026947 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:21.084850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b530c-eccc-4186-83f6-b0f03c0ea2e3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:21.090507 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:21.091262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.091612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.091930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.092667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:21.094631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:21.117028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-feafe6d2-08ee-4565-b538-98976b2ba51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc4a76a00d447abad9e997f9efbb08d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:21.123576 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1380/2762] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:20 2022] DELETE /identity/v3/users/6dc4a76a00d447abad9e997f9efbb08d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:21.129676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.129676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.129676 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.146879 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:21.148371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:21.206973 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1383/2763] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:21 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:21.208396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1381/2764] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:21.210483 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:21.212546 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:21.218876 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:21.220304 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:21.225117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414ae06-6d45-4953-ac6a-83e87d70c631 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:21.230520 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:21.231186 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.231493 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.232059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.232538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:21.234613 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:21.245431 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1384/2765] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:21.250840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:21.262033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33cf7-7831-422d-8676-e7dabc8f696a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:21.267371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:21.268036 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.268355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.268628 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.269359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:21.270952 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:21.282951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40f037-f6a9-4c16-9c40-987d3041c43b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:21.287055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1385/2766] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:21.287971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:21.289933 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2832e-4f3a-4346-85b8-77e982c4bb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:21.299755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2832e-4f3a-4346-85b8-77e982c4bb97 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.299755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2832e-4f3a-4346-85b8-77e982c4bb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.299755 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2832e-4f3a-4346-85b8-77e982c4bb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.300100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e872-e24e-45db-aa5a-6737b1beb9eb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:21.301865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2832e-4f3a-4346-85b8-77e982c4bb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:21.303542 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:21.303780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2832e-4f3a-4346-85b8-77e982c4bb97 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:21.304609 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.304894 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.305174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] PATH_INFO: `/v3/projects/d83f12d00ac345798ca7ba9c8d7d96a6/users/61d3add5a2cc44cb837a25bc5df192e0/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.314753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1382/2767] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:27:21.320813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83f12d00ac345798ca7ba9c8d7d96a6, user_id=61d3add5a2cc44cb837a25bc5df192e0, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:21.324664 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:21.404042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1386/2768] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:21 2022] PUT /identity/v3/projects/d83f12d00ac345798ca7ba9c8d7d96a6/users/61d3add5a2cc44cb837a25bc5df192e0/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:21.414008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.414302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.414586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.441859 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] MFA Rules not processed for user `61d3add5a2cc44cb837a25bc5df192e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:21.443090 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:21.512483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1383/2769] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:21.524110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:21.525897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:21.603668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a132-2c6f-4cd6-b1d5-505297b77933 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:21.607614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:21.608259 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.608541 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.608810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.617524 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:21.619050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:21.630612 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1387/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:27:21.753514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:21.756445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:21.795848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:21.832712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3e767-1d23-48d6-9be6-bacbeeb11fbe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:21.837338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:21.838190 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:21.838514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:21.838988 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] PATH_INFO: `/v3/projects/3956a6034cd640b0a306b1028e855b3c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:21.840353 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3956a6034cd640b0a306b1028e855b3c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:21.842257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:21.974742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3956a6034cd640b0a306b1028e855b3c', 'request_id': 'req-8fc99e36-2784-4e93-87bf-5dd6c6549eea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:21.981835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3956a6034cd640b0a306b1028e855b3c', 'request_id': 'req-8fc99e36-2784-4e93-87bf-5dd6c6549eea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.106217 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3956a6034cd640b0a306b1028e855b3c', 'request_id': 'req-8fc99e36-2784-4e93-87bf-5dd6c6549eea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.117775 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] The token cache is being invalidate because project 3956a6034cd640b0a306b1028e855b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:22.118063 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.118753 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.121159 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1384/2771] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:21 2022] DELETE /identity/v3/projects/3956a6034cd640b0a306b1028e855b3c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:22.125203 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:22.136087 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e45d2-f91d-49af-aae2-b8ce604797a7 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:22.176944 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:22.192762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:22.193553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:22.193828 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:22.194104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] PATH_INFO: `/v3/users/b9c119e9f5f341dbb405943114e41c02` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:22.195262 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c119e9f5f341dbb405943114e41c02)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:22.197195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:22.388586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c119e9f5f341dbb405943114e41c02'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.395989 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c119e9f5f341dbb405943114e41c02'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.396696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c119e9f5f341dbb405943114e41c02'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.397296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c119e9f5f341dbb405943114e41c02'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.410420 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c119e9f5f341dbb405943114e41c02'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:22.522485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1388/2772] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:22 2022] DELETE /identity/v3/users/b9c119e9f5f341dbb405943114e41c02 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:22.929078 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:22.930613 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:22.946408 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc99e36-2784-4e93-87bf-5dd6c6549eea admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:23.006285 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:23.007074 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:23.007351 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:23.007628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] PATH_INFO: `/v3/projects/eae027dd91f4493489c9d4d7f3af3750` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:23.008873 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae027dd91f4493489c9d4d7f3af3750)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:23.011371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:23.152076 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae027dd91f4493489c9d4d7f3af3750', 'request_id': 'req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.157482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae027dd91f4493489c9d4d7f3af3750', 'request_id': 'req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.159968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:23.254365 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae027dd91f4493489c9d4d7f3af3750', 'request_id': 'req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.267985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] The token cache is being invalidate because project eae027dd91f4493489c9d4d7f3af3750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:23.268312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.268963 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.270529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1385/2773] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:22 2022] DELETE /identity/v3/projects/eae027dd91f4493489c9d4d7f3af3750 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:23.274505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:23.276217 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:23.293445 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f00e-eace-4bee-8270-37a2f9b32314 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:23.355854 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:23.356929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:23.357097 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:23.357378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] PATH_INFO: `/v3/users/638cf87269a045beb0312bc0f6221bc3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:23.358583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=638cf87269a045beb0312bc0f6221bc3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:23.360607 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:23.514987 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638cf87269a045beb0312bc0f6221bc3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.522582 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638cf87269a045beb0312bc0f6221bc3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.523121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638cf87269a045beb0312bc0f6221bc3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.523794 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638cf87269a045beb0312bc0f6221bc3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.531124 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:23.536475 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-624813c4-b575-4370-baf3-ebe5bf37f74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638cf87269a045beb0312bc0f6221bc3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:23.671946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1389/2774] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:23 2022] DELETE /identity/v3/users/638cf87269a045beb0312bc0f6221bc3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:24.072106 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:24.074251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:24.089934 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda2bc-d86e-4814-a7ac-b8cd93a31077 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:24.147581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:24.148468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.148752 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.149028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] PATH_INFO: `/v3/projects/33ae5a2a30154296b7d0384df1f899c6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.150259 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ae5a2a30154296b7d0384df1f899c6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:24.153005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:24.310336 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ae5a2a30154296b7d0384df1f899c6', 'request_id': 'req-cccca890-7435-4f55-9814-f73ef720e52d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:24.315888 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ae5a2a30154296b7d0384df1f899c6', 'request_id': 'req-cccca890-7435-4f55-9814-f73ef720e52d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:24.400382 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ae5a2a30154296b7d0384df1f899c6', 'request_id': 'req-cccca890-7435-4f55-9814-f73ef720e52d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:24.412482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] The token cache is being invalidate because project 33ae5a2a30154296b7d0384df1f899c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:24.412767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:24.413393 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cccca890-7435-4f55-9814-f73ef720e52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:24.414940 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1386/2775] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:24 2022] DELETE /identity/v3/projects/33ae5a2a30154296b7d0384df1f899c6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:24.420464 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cafe-84db-4494-9d23-9b59bf178128 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.420964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cafe-84db-4494-9d23-9b59bf178128 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.421064 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cafe-84db-4494-9d23-9b59bf178128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.439211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-df59cafe-84db-4494-9d23-9b59bf178128 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:24.440557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-df59cafe-84db-4494-9d23-9b59bf178128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:24.499509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1390/2776] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:24.507231 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154feb9c-19d6-45fb-827b-bb2bb1863033 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.507518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154feb9c-19d6-45fb-827b-bb2bb1863033 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.507797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154feb9c-19d6-45fb-827b-bb2bb1863033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.525700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-154feb9c-19d6-45fb-827b-bb2bb1863033 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:24.527619 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-154feb9c-19d6-45fb-827b-bb2bb1863033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:24.536881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1387/2777] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:24.540996 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59cafe-84db-4494-9d23-9b59bf178128 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:24.551511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59cafe-84db-4494-9d23-9b59bf178128 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:24.556572 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:24.557123 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.557360 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.557631 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.559055 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:27:24.559659 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:24.561268 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:24.573559 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1391/2778] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:27:24.578525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154feb9c-19d6-45fb-827b-bb2bb1863033 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:24.587842 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154feb9c-19d6-45fb-827b-bb2bb1863033 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:24.593708 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:24.594356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.594634 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.594901 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.595575 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:24.597512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:24.694165 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1388/2779] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:24 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:24.695308 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:24.706813 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a9cf-33ed-4956-b342-970abaa3ed1b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:24.766428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:24.767092 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.767371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.767668 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.768390 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:24.770327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:24.834583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1392/2780] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:24 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:24.836061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:24.847710 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e0d9-7d90-4688-9c58-65cfebd27ad1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:24.852415 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:24.853094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.853373 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.853641 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.854355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:24.856929 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:24.867480 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1389/2781] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:24.871619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:24.881471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77f5c-85a2-4fd9-8cce-e9ff94ed6b0c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:24.886592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff5b2-b769-4681-91d4-5fa4fe4e76cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:24.888862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff5b2-b769-4681-91d4-5fa4fe4e76cf admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.888862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff5b2-b769-4681-91d4-5fa4fe4e76cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.888862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff5b2-b769-4681-91d4-5fa4fe4e76cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.888862 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ff5b2-b769-4681-91d4-5fa4fe4e76cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:24.890244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ff5b2-b769-4681-91d4-5fa4fe4e76cf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:24.900672 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1393/2782] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:27:24.905596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:24.915743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0a658-1e85-4f39-8b4e-00182d401b11 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:24.920648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:24.921520 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:24.921806 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:24.922084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] PATH_INFO: `/v3/projects/7e1a997836914066a8aa2ebe98396d1b/users/ad7359641c2f42f5887153ce08bad096/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:24.937326 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1a997836914066a8aa2ebe98396d1b, user_id=ad7359641c2f42f5887153ce08bad096, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:24.940018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:25.040323 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1390/2783] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:24 2022] PUT /identity/v3/projects/7e1a997836914066a8aa2ebe98396d1b/users/ad7359641c2f42f5887153ce08bad096/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:25.045580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26e2f-5162-43b0-96c3-45e1edc89446 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:25.045879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26e2f-5162-43b0-96c3-45e1edc89446 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:25.046185 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26e2f-5162-43b0-96c3-45e1edc89446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:25.064310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9cd26e2f-5162-43b0-96c3-45e1edc89446 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:25.065527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9cd26e2f-5162-43b0-96c3-45e1edc89446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:25.113994 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:25.130839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1394/2784] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:25.141493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:25.143426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:25.170221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:25.219952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394860bb-9706-4ddc-a502-b4d0bbacb2ef admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:25.223714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:25.224359 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:25.224670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:25.224949 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:25.234568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:25.235984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:25.248302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1391/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:26.567052 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb8d4-8ae3-49e3-919d-f72e50d9c9b6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:26.567554 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb8d4-8ae3-49e3-919d-f72e50d9c9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:26.567839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb8d4-8ae3-49e3-919d-f72e50d9c9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:26.597013 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-55feb8d4-8ae3-49e3-919d-f72e50d9c9b6 None None] MFA Rules not processed for user `ad7359641c2f42f5887153ce08bad096`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:26.598350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-55feb8d4-8ae3-49e3-919d-f72e50d9c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:26.665347 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1395/2786] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:26.676177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:26.677569 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:26.737083 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5423a9e-d278-40eb-a5f8-90c192fce0bb service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:26.740778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:26.741435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:26.741713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:26.741984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:26.750885 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:26.752343 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:26.762227 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1392/2787] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:28.665577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd729e57-9e33-470e-907b-a0cff2130e79 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:28.666107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd729e57-9e33-470e-907b-a0cff2130e79 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:28.666107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd729e57-9e33-470e-907b-a0cff2130e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:28.686153 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fd729e57-9e33-470e-907b-a0cff2130e79 None None] MFA Rules not processed for user `ad7359641c2f42f5887153ce08bad096`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:28.687389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fd729e57-9e33-470e-907b-a0cff2130e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:28.694412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1396/2788] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:36.757072 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=45 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:38.679847 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=40 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:46.778025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:46.779423 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:46.793388 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64051f-5bda-48d1-be56-7b8159af1feb service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:46.798950 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:46.799810 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:46.800133 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:46.801791 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] PATH_INFO: `/v3/users/61d3add5a2cc44cb837a25bc5df192e0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:46.803198 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d3add5a2cc44cb837a25bc5df192e0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:46.806518 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:46.994356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d3add5a2cc44cb837a25bc5df192e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.010292 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d3add5a2cc44cb837a25bc5df192e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.018955 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d3add5a2cc44cb837a25bc5df192e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.019898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d3add5a2cc44cb837a25bc5df192e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.108698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d3add5a2cc44cb837a25bc5df192e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.117488 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1393/2789] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:46 2022] DELETE /identity/v3/users/61d3add5a2cc44cb837a25bc5df192e0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:47.121808 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:47.122297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:47.122405 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:47.143757 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:47.144990 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:47.205633 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1397/2790] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:47.215124 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:47.216582 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:47.277086 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fd146-1bad-45a5-be45-2be88f6fb658 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:47.280712 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e463b1-eaf0-4601-adf8-0a131f32c951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:47.282031 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e463b1-eaf0-4601-adf8-0a131f32c951 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:47.282310 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e463b1-eaf0-4601-adf8-0a131f32c951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:47.282581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e463b1-eaf0-4601-adf8-0a131f32c951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:47.291511 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e463b1-eaf0-4601-adf8-0a131f32c951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:47.292979 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e463b1-eaf0-4601-adf8-0a131f32c951 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:47.302405 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1394/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:47.682964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:47.684387 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:47.697839 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcd39a-ac80-4388-aa6b-a11984162896 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:47.702470 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:47.704388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:47.704388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:47.704576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] PATH_INFO: `/v3/projects/d83f12d00ac345798ca7ba9c8d7d96a6` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:47.705810 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83f12d00ac345798ca7ba9c8d7d96a6)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:47.707730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:47.829785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83f12d00ac345798ca7ba9c8d7d96a6', 'request_id': 'req-71d5b758-c655-436a-849f-29970c21304e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.919798 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83f12d00ac345798ca7ba9c8d7d96a6', 'request_id': 'req-71d5b758-c655-436a-849f-29970c21304e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.926400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83f12d00ac345798ca7ba9c8d7d96a6', 'request_id': 'req-71d5b758-c655-436a-849f-29970c21304e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.936982 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] The token cache is being invalidate because project d83f12d00ac345798ca7ba9c8d7d96a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:47.937269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.938530 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-71d5b758-c655-436a-849f-29970c21304e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:47.940145 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1398/2792] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:47 2022] DELETE /identity/v3/projects/d83f12d00ac345798ca7ba9c8d7d96a6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:27:47.945044 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de30a1-d9c0-4c00-bcc1-53eedc1167f6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:47.945541 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de30a1-d9c0-4c00-bcc1-53eedc1167f6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:47.945652 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de30a1-d9c0-4c00-bcc1-53eedc1167f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:47.964214 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a1de30a1-d9c0-4c00-bcc1-53eedc1167f6 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:47.965431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1de30a1-d9c0-4c00-bcc1-53eedc1167f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:48.025470 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1395/2793] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:27:48.034346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800c314-2006-4991-b746-f4ad986ddde5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.034634 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800c314-2006-4991-b746-f4ad986ddde5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.034917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800c314-2006-4991-b746-f4ad986ddde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.054169 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0800c314-2006-4991-b746-f4ad986ddde5 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:48.055343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0800c314-2006-4991-b746-f4ad986ddde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:48.067060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1399/2794] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:48.076178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de30a1-d9c0-4c00-bcc1-53eedc1167f6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:48.086051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de30a1-d9c0-4c00-bcc1-53eedc1167f6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:48.094688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:48.101956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.101956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.101956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.101956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:27:48.101956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:48.101956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:48.114957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1396/2795] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:27:48.116015 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800c314-2006-4991-b746-f4ad986ddde5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:48.125215 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800c314-2006-4991-b746-f4ad986ddde5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:48.131119 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:48.131662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.132227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.132227 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.132921 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:48.134790 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:48.249959 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1400/2796] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:27:48 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:27:48.257081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:48.257966 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:48.263482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b4e8a-3504-4577-9898-9a529a96943b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:48.328180 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:48.328948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.329254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.329534 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.330234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:48.332234 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:48.401607 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1397/2797] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:27:48 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:27:48.405669 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:48.417116 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba35e3c-8cfa-4b9b-91fd-df6370034f14 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:48.421662 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:48.423415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.423974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.423974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.424709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:48.426286 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:48.437378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1401/2798] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:48.441328 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:48.452418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee03a70-7bce-4db0-8e5f-98650be96fa8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:48.457395 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf6f0a-9dbe-49b4-bae6-13d28a1bd053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:48.458431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6f0a-9dbe-49b4-bae6-13d28a1bd053 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.458431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6f0a-9dbe-49b4-bae6-13d28a1bd053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.458733 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6f0a-9dbe-49b4-bae6-13d28a1bd053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.459498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf6f0a-9dbe-49b4-bae6-13d28a1bd053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:48.461154 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf6f0a-9dbe-49b4-bae6-13d28a1bd053 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:48.472040 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1398/2799] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:27:48.476170 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:48.487880 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eaef8-9fbf-4b5e-840c-6441cd02cb1e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:48.493071 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:48.493947 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.494226 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.494498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] PATH_INFO: `/v3/projects/4a16f10432974c109d9d0c0a47813437/users/17582cda9d0344ca99dbf5ecfd997e6a/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.511468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a16f10432974c109d9d0c0a47813437, user_id=17582cda9d0344ca99dbf5ecfd997e6a, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:48.514229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:48.623359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1402/2800] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:27:48 2022] PUT /identity/v3/projects/4a16f10432974c109d9d0c0a47813437/users/17582cda9d0344ca99dbf5ecfd997e6a/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:48.634178 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3930e85-d0ad-4f26-b54c-d92abb840d4c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.634472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3930e85-d0ad-4f26-b54c-d92abb840d4c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.634756 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3930e85-d0ad-4f26-b54c-d92abb840d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.662239 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f3930e85-d0ad-4f26-b54c-d92abb840d4c None None] MFA Rules not processed for user `17582cda9d0344ca99dbf5ecfd997e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:48.663368 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f3930e85-d0ad-4f26-b54c-d92abb840d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:48.728335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1399/2801] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:48.740592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:48.742260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:48.764644 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:48.804163 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea6c7-b82c-4d7a-89e1-5d8ad040e50c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:48.807986 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:48.809212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:48.809212 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:48.809448 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:48.819359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:48.820874 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:48.832579 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1403/2802] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:51.657957 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8cf3-5fcc-4f5d-888d-385cf68bce0c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:51.658459 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8cf3-5fcc-4f5d-888d-385cf68bce0c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:51.658570 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8cf3-5fcc-4f5d-888d-385cf68bce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:51.678672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b69d8cf3-5fcc-4f5d-888d-385cf68bce0c None None] MFA Rules not processed for user `ad7359641c2f42f5887153ce08bad096`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:51.679999 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b69d8cf3-5fcc-4f5d-888d-385cf68bce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:51.739203 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1400/2803] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:52.201678 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:52.203122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:52.273702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075291-a601-4279-b36a-aa8439664391 service glance] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:52.278294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:52.279151 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:52.279428 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:52.279709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] PATH_INFO: `/v3/users/f490ec1439f24f808d6f4f17230ce6ce` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:52.280933 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f490ec1439f24f808d6f4f17230ce6ce)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:52.283503 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:52.508343 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f490ec1439f24f808d6f4f17230ce6ce'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:52.519100 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f490ec1439f24f808d6f4f17230ce6ce'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:52.519950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f490ec1439f24f808d6f4f17230ce6ce'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:52.522008 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f490ec1439f24f808d6f4f17230ce6ce'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:52.535861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f490ec1439f24f808d6f4f17230ce6ce'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:52.625204 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1404/2804] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:27:52 2022] DELETE /identity/v3/users/f490ec1439f24f808d6f4f17230ce6ce => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:27:52.630482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:52.630772 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:52.631053 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:52.649374 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:27:52.650567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:52.660051 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:52.712252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1401/2805] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:27:52.722095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:52.723531 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:52.781316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:27:52.793250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22a02b-0c7f-43cd-95df-f0d86e01aaea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:52.796872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04552bbb-83e8-49a2-abf0-2cc5e60f53b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:52.798368 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04552bbb-83e8-49a2-abf0-2cc5e60f53b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:52.798593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04552bbb-83e8-49a2-abf0-2cc5e60f53b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:52.798805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04552bbb-83e8-49a2-abf0-2cc5e60f53b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:52.808903 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04552bbb-83e8-49a2-abf0-2cc5e60f53b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:52.810772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04552bbb-83e8-49a2-abf0-2cc5e60f53b6 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:52.822494 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1405/2806] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:27:53.284621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:27:53.286170 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:27:53.298666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4370-8028-4623-bdeb-f982f2b311af None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:27:53.303549 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:27:53.304547 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:27:53.304894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:27:53.305266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] PATH_INFO: `/v3/projects/f65ff04528c64c91ac664da8aeed9054` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:27:53.306562 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65ff04528c64c91ac664da8aeed9054)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:27:53.312751 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:27:53.421120 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65ff04528c64c91ac664da8aeed9054', 'request_id': 'req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:53.427725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65ff04528c64c91ac664da8aeed9054', 'request_id': 'req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:53.491347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65ff04528c64c91ac664da8aeed9054', 'request_id': 'req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:53.506589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] The token cache is being invalidate because project f65ff04528c64c91ac664da8aeed9054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:27:53.506898 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:53.507536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:27:53.511211 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1402/2807] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:27:53 2022] DELETE /identity/v3/projects/f65ff04528c64c91ac664da8aeed9054 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:03.013228 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:03.503487 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:23.081610 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:23.082781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:23.082781 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:23.100127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:23.101371 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:23.161315 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1406/2808] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:28:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:23.290297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:23.291741 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:23.369925 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3411a-b895-4b17-bcc0-ba47e0b446ba admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:23.377391 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88a251-c608-4e86-8cf7-cfe7751f5a25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:23.378115 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a251-c608-4e86-8cf7-cfe7751f5a25 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:23.378416 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a251-c608-4e86-8cf7-cfe7751f5a25 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:23.378679 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a251-c608-4e86-8cf7-cfe7751f5a25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:23.390989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88a251-c608-4e86-8cf7-cfe7751f5a25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:23.390989 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88a251-c608-4e86-8cf7-cfe7751f5a25 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:23.398723 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1403/2809] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:28:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:28:28.298412 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:28.300667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:28.393617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6f17a-6cb7-422d-8d97-e49bea5e4200 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:28.399641 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:28.401070 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:28.401575 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:28.402062 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] PATH_INFO: `/v3/users/17582cda9d0344ca99dbf5ecfd997e6a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:28.403333 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17582cda9d0344ca99dbf5ecfd997e6a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:28.405316 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:28.674653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17582cda9d0344ca99dbf5ecfd997e6a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:28.684887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17582cda9d0344ca99dbf5ecfd997e6a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:28.685967 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17582cda9d0344ca99dbf5ecfd997e6a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:28.686719 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17582cda9d0344ca99dbf5ecfd997e6a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:28.710248 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17582cda9d0344ca99dbf5ecfd997e6a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:28.794206 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1407/2810] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:28:28 2022] DELETE /identity/v3/users/17582cda9d0344ca99dbf5ecfd997e6a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:28.794629 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:28.795094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:28.795196 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:28.819439 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:28.820740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:28.891771 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1404/2811] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:28:28.903919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:28.906068 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:28.948179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:28.986175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d286f-003f-4f55-8309-c754481a731b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:28.990638 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657da0a-b10d-4251-b87f-57c505d86eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:28.991320 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657da0a-b10d-4251-b87f-57c505d86eae service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:28.991608 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657da0a-b10d-4251-b87f-57c505d86eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:28.991892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657da0a-b10d-4251-b87f-57c505d86eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:29.003584 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657da0a-b10d-4251-b87f-57c505d86eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:29.006088 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657da0a-b10d-4251-b87f-57c505d86eae service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:29.017457 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1408/2812] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:28:29.692819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:29.694440 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:29.708714 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bbffc-7101-4460-870e-c594b0152b32 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:29.714212 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:29.715089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:29.715371 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:29.715646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] PATH_INFO: `/v3/projects/4a16f10432974c109d9d0c0a47813437` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:29.716872 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a16f10432974c109d9d0c0a47813437)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:29.719300 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:29.867766 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a16f10432974c109d9d0c0a47813437', 'request_id': 'req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:29.876103 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a16f10432974c109d9d0c0a47813437', 'request_id': 'req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:29.948830 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a16f10432974c109d9d0c0a47813437', 'request_id': 'req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:29.961788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] The token cache is being invalidate because project 4a16f10432974c109d9d0c0a47813437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:28:29.962338 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:29.963296 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2166a6c6-8f8d-493c-ad5c-88c0d5386e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:29.965348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1405/2813] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:28:29 2022] DELETE /identity/v3/projects/4a16f10432974c109d9d0c0a47813437 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:29.970527 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176431-f913-4fda-9538-ca7ac0c41134 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:29.971044 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176431-f913-4fda-9538-ca7ac0c41134 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:29.971167 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176431-f913-4fda-9538-ca7ac0c41134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:29.991153 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a7176431-f913-4fda-9538-ca7ac0c41134 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:29.992458 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a7176431-f913-4fda-9538-ca7ac0c41134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:30.071005 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1409/2814] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:30.075476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4089466-7e5f-437e-90d4-777e9fbc76e4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.076188 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4089466-7e5f-437e-90d4-777e9fbc76e4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.076590 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4089466-7e5f-437e-90d4-777e9fbc76e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.102431 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c4089466-7e5f-437e-90d4-777e9fbc76e4 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:30.104122 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c4089466-7e5f-437e-90d4-777e9fbc76e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:30.112422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1406/2815] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:30.116912 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176431-f913-4fda-9538-ca7ac0c41134 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:30.127303 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176431-f913-4fda-9538-ca7ac0c41134 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:30.132267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:30.132932 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.133216 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.133526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.134234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:28:30.134544 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:30.136150 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:30.150035 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1410/2816] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:28:30.154071 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4089466-7e5f-437e-90d4-777e9fbc76e4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:30.169544 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4089466-7e5f-437e-90d4-777e9fbc76e4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:30.175096 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:30.175941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.176573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.177024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.177730 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:30.183804 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:30.189038 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:30.266147 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1407/2817] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:28:30 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:30.267525 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:30.282732 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d4a5-c195-4c0f-b043-a4820feaa2c6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:30.353357 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:30.354363 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.354655 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.354929 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.356915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:30.357741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:30.436244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1411/2818] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:28:30 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:30.439630 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:30.451675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59b74-7c1a-4e79-b2a6-256c53da8952 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:30.458192 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:30.458871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.462451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.462451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.462451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:30.462451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:30.476646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1408/2819] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:30.480379 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:30.492059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4751-a4d2-4a9a-acee-425ff711e5e8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:30.498041 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2911f-2342-42e4-ae19-ea994520283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:30.498786 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2911f-2342-42e4-ae19-ea994520283d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.499141 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2911f-2342-42e4-ae19-ea994520283d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.499508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2911f-2342-42e4-ae19-ea994520283d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.500346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2911f-2342-42e4-ae19-ea994520283d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:30.502006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2911f-2342-42e4-ae19-ea994520283d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:30.517341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1412/2820] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:30.521284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:30.534778 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617827ca-dd70-471e-a938-aed76e40a2fe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:30.540891 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:30.542097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.542591 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.543056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] PATH_INFO: `/v3/projects/765c1f1b4bcf407ab16bd805e91e7541/users/17f6c25223c7470891a0f33b59d69dd3/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.564023 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765c1f1b4bcf407ab16bd805e91e7541, user_id=17f6c25223c7470891a0f33b59d69dd3, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:30.571095 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:30.635707 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1409/2821] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:28:30 2022] PUT /identity/v3/projects/765c1f1b4bcf407ab16bd805e91e7541/users/17f6c25223c7470891a0f33b59d69dd3/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:30.647957 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e44e8-e812-475f-8833-9d9ece00db50 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.650081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e44e8-e812-475f-8833-9d9ece00db50 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.650081 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e44e8-e812-475f-8833-9d9ece00db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.682258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6b5e44e8-e812-475f-8833-9d9ece00db50 None None] MFA Rules not processed for user `17f6c25223c7470891a0f33b59d69dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:30.683580 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b5e44e8-e812-475f-8833-9d9ece00db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:30.714749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:30.776762 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1413/2822] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:30.785780 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:30.787696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:30.874476 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258939a-a9ed-4f88-a121-e12e0585fff7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:30.878472 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c4b77-96fa-449d-8187-7d4c8ded01d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32681494192c4f6c9ba36d68e4b6399b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:30.880329 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c4b77-96fa-449d-8187-7d4c8ded01d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:30.880722 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c4b77-96fa-449d-8187-7d4c8ded01d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:30.881058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c4b77-96fa-449d-8187-7d4c8ded01d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:30.892257 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c4b77-96fa-449d-8187-7d4c8ded01d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:30.893765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c4b77-96fa-449d-8187-7d4c8ded01d2 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:30.911404 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1410/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:28:39.927981 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e44e8-e812-475f-8833-9d9ece00db50 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:39.995693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e44e8-e812-475f-8833-9d9ece00db50 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:40.000647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:40.004181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:40.004181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:40.004181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] PATH_INFO: `/v3/users/17f6c25223c7470891a0f33b59d69dd3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:40.004181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f6c25223c7470891a0f33b59d69dd3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:40.005328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:40.043370 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:40.043828 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:40.043945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:40.061840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:40.063026 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:40.121739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1411/2824] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 08:28:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:28:40.134924 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:40.136341 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:40.188778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f6c25223c7470891a0f33b59d69dd3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:40.198624 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f6c25223c7470891a0f33b59d69dd3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:40.199693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f6c25223c7470891a0f33b59d69dd3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:40.200439 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f6c25223c7470891a0f33b59d69dd3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:40.211158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:40.221884 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f6c25223c7470891a0f33b59d69dd3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:40.227767 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b695b-3efd-4f31-a140-1dc16e69c43f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:40.234045 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571018be-a738-44dc-8a37-4288cf3cefd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:40.235114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571018be-a738-44dc-8a37-4288cf3cefd7 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:40.235747 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571018be-a738-44dc-8a37-4288cf3cefd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:40.236546 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571018be-a738-44dc-8a37-4288cf3cefd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:40.239363 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-571018be-a738-44dc-8a37-4288cf3cefd7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:40.251785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571018be-a738-44dc-8a37-4288cf3cefd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:40.253398 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571018be-a738-44dc-8a37-4288cf3cefd7 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:40.262294 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1412/2825] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:28:40.281597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1414/2826] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:28:39 2022] DELETE /identity/v3/users/17f6c25223c7470891a0f33b59d69dd3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:40.286493 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:40.286881 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:40.287175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:40.304786 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:40.306451 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:40.365960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1413/2827] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:40.375647 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:40.377312 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:40.447971 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:40.461348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453aad63-6b82-4efd-b486-d030b6520035 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:40.465060 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc3aa2-e482-4342-bc1c-1b85b506eb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:40.465713 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc3aa2-e482-4342-bc1c-1b85b506eb90 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:40.465999 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc3aa2-e482-4342-bc1c-1b85b506eb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:40.466277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc3aa2-e482-4342-bc1c-1b85b506eb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:40.476136 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc3aa2-e482-4342-bc1c-1b85b506eb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:40.478341 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc3aa2-e482-4342-bc1c-1b85b506eb90 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:40.487400 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1415/2828] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:28:40.912877 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:40.914237 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:40.942666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872c602-8110-436b-b0d4-ecccee6c4281 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:40.947783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:40.948762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:40.948995 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:40.960018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] PATH_INFO: `/v3/projects/765c1f1b4bcf407ab16bd805e91e7541` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:40.960018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765c1f1b4bcf407ab16bd805e91e7541)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:40.960018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:41.134030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765c1f1b4bcf407ab16bd805e91e7541', 'request_id': 'req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:41.142696 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765c1f1b4bcf407ab16bd805e91e7541', 'request_id': 'req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:41.224645 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765c1f1b4bcf407ab16bd805e91e7541', 'request_id': 'req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:41.247709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] The token cache is being invalidate because project 765c1f1b4bcf407ab16bd805e91e7541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:28:41.247996 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:41.248684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-88c41b7d-7467-4b8b-a9d6-8c9f7ca07e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:41.250871 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1414/2829] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:28:40 2022] DELETE /identity/v3/projects/765c1f1b4bcf407ab16bd805e91e7541 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:41.255877 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc17b-4025-4233-8bfe-d28edd326b98 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.256435 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc17b-4025-4233-8bfe-d28edd326b98 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.256565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc17b-4025-4233-8bfe-d28edd326b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.283270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-243bc17b-4025-4233-8bfe-d28edd326b98 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:41.284509 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-243bc17b-4025-4233-8bfe-d28edd326b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:41.363727 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1416/2830] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:41.372706 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030d19-a435-4b71-b23c-31de02bdc168 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.373017 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030d19-a435-4b71-b23c-31de02bdc168 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.373307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030d19-a435-4b71-b23c-31de02bdc168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.396690 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d1030d19-a435-4b71-b23c-31de02bdc168 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:41.398005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1030d19-a435-4b71-b23c-31de02bdc168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:41.427261 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1415/2831] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:41.428745 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bc17b-4025-4233-8bfe-d28edd326b98 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:41.440741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bc17b-4025-4233-8bfe-d28edd326b98 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:41.448646 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:41.449974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.450484 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.451235 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.452089 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:28:41.452577 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:41.454696 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:41.472241 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1417/2832] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:28:41.475175 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030d19-a435-4b71-b23c-31de02bdc168 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:41.489900 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030d19-a435-4b71-b23c-31de02bdc168 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:41.494982 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:41.495649 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.495968 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.496266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.497018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:41.498920 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:41.506296 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:41.508140 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:41.574685 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7e79-19b4-45a3-b7a7-f1bbcd099409 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:41.584348 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:41.585012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.585291 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.585565 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.587350 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:41.638985 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1416/2833] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:28:41 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:41.643117 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:41.676346 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:41.677892 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:41.692946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1418/2834] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:28:41.730157 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:41.748715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39988-dd81-49e2-ab32-e54451fed1cd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:41.753788 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:41.754666 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.754984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.755236 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.755892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:41.757857 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:41.850588 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1417/2835] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:28:41 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:41.851923 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:41.864538 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d443fa-3974-49b5-869e-3a8719922092 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:41.869220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:41.869876 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.870165 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.870413 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.871131 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:41.872827 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:41.886642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1419/2836] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:41.887743 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:41.897998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036b94a-b6a6-443b-97d2-838796042050 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:41.906530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab80f79-7985-4761-9b63-e574bf14b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:41.907248 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80f79-7985-4761-9b63-e574bf14b513 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.907537 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80f79-7985-4761-9b63-e574bf14b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.907813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80f79-7985-4761-9b63-e574bf14b513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.908675 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab80f79-7985-4761-9b63-e574bf14b513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:41.911142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab80f79-7985-4761-9b63-e574bf14b513 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:41.921952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1418/2837] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:28:41.926800 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:41.932677 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:41.938517 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcb18-55b8-4da0-87ce-064e470c453a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:41.944028 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:41.946066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:41.946066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:41.946066 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] PATH_INFO: `/v3/projects/bdb93f2721d548d7b01475fb650d882f/users/a9150eafa2cc41f5ac56105976d658a2/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:41.962229 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb93f2721d548d7b01475fb650d882f, user_id=a9150eafa2cc41f5ac56105976d658a2, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:41.965067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:42.103474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1420/2838] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:28:41 2022] PUT /identity/v3/projects/bdb93f2721d548d7b01475fb650d882f/users/a9150eafa2cc41f5ac56105976d658a2/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:42.108856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f01d1-0cb8-4b9b-a6de-94841f67a53e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:42.109155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f01d1-0cb8-4b9b-a6de-94841f67a53e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:42.109463 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f01d1-0cb8-4b9b-a6de-94841f67a53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:42.130506 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d78f01d1-0cb8-4b9b-a6de-94841f67a53e None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:42.131914 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d78f01d1-0cb8-4b9b-a6de-94841f67a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:42.200174 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1419/2839] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:42.206389 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:42.266335 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857db13-c3b0-4697-9054-c4566966d952 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:42.270623 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:42.271328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:42.271617 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:42.271897 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:42.281422 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:42.282858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:42.292914 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1421/2840] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:28:42.898199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f01d1-0cb8-4b9b-a6de-94841f67a53e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:42.909765 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f01d1-0cb8-4b9b-a6de-94841f67a53e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:42.914909 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:42.918034 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:42.918536 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:42.918930 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:42.920892 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:43.012819 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:43.014430 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:43.028018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1420/2841] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:28:43.605866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:43.607472 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:43.625178 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477e46f-8f6c-4e18-a5c0-ff903dc5ec19 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:43.631243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:43.631243 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:43.631653 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:43.632067 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] PATH_INFO: `/v3/users/ad7359641c2f42f5887153ce08bad096` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:43.633299 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7359641c2f42f5887153ce08bad096)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:43.635275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:43.833129 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7359641c2f42f5887153ce08bad096'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:43.840340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7359641c2f42f5887153ce08bad096'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:43.841126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7359641c2f42f5887153ce08bad096'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:43.841753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7359641c2f42f5887153ce08bad096'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:43.855056 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24324967-8928-4c28-a8e2-d5f040493c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7359641c2f42f5887153ce08bad096'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:43.918964 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1422/2842] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:28:43 2022] DELETE /identity/v3/users/ad7359641c2f42f5887153ce08bad096 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:44.304665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:44.333538 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97090730-d59c-4e71-b80c-95a5d3cf5f5a service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:44.396875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:44.411507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:44.412646 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:44.413094 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:44.413533 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] PATH_INFO: `/v3/projects/7e1a997836914066a8aa2ebe98396d1b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:44.415644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1a997836914066a8aa2ebe98396d1b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:44.417814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:44.557146 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1a997836914066a8aa2ebe98396d1b', 'request_id': 'req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:44.579969 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1a997836914066a8aa2ebe98396d1b', 'request_id': 'req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:44.686792 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1a997836914066a8aa2ebe98396d1b', 'request_id': 'req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:44.702539 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] The token cache is being invalidate because project 7e1a997836914066a8aa2ebe98396d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:28:44.702936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:44.703777 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0bc4dbe-3fbc-4047-a06b-40a5c3568715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:28:44.711588 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165afce-08f6-46b8-80f5-f66a3c250736 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:44.712048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165afce-08f6-46b8-80f5-f66a3c250736 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:44.712274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165afce-08f6-46b8-80f5-f66a3c250736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:44.713789 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1421/2843] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:28:44 2022] DELETE /identity/v3/projects/7e1a997836914066a8aa2ebe98396d1b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:44.733848 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0165afce-08f6-46b8-80f5-f66a3c250736 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:44.736345 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0165afce-08f6-46b8-80f5-f66a3c250736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:44.808174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:44.822306 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1423/2844] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:44.830228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56992-e528-44ca-b350-a6d7b446b659 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:44.830530 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56992-e528-44ca-b350-a6d7b446b659 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:44.830807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56992-e528-44ca-b350-a6d7b446b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:44.852783 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-71c56992-e528-44ca-b350-a6d7b446b659 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:44.854253 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-71c56992-e528-44ca-b350-a6d7b446b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:44.862964 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1422/2845] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:44.867314 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165afce-08f6-46b8-80f5-f66a3c250736 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:44.879104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165afce-08f6-46b8-80f5-f66a3c250736 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:44.884536 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:44.885305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:44.885589 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:44.885980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:44.886712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:28:44.887199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:44.889378 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:44.903879 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1424/2846] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 08:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:28:44.908561 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c56992-e528-44ca-b350-a6d7b446b659 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:44.921986 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c56992-e528-44ca-b350-a6d7b446b659 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:44.935348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:44.935348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:44.935348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:44.935348 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:44.944491 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:44.948726 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:45.056358 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1423/2847] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:28:44 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:45.061132 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:45.072962 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa99be-988a-4891-8f48-4a261f1db3b5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:45.146583 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:45.147498 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:45.147783 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:45.148059 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:45.148823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:45.150930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:45.270702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1425/2848] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:28:45 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:28:45.274745 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:45.286252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685968f-3d48-4bf6-b223-91cc9a78abd8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:45.290943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:45.291601 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:45.291882 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:45.292160 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:45.292913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:45.294501 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:45.309894 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1424/2849] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:45.315682 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:45.325050 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a2d2-0d9a-4693-8bc8-72c52b194eef admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:45.329974 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38703ea-3bec-41c5-827a-97771e941b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:45.330906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38703ea-3bec-41c5-827a-97771e941b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:45.332543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38703ea-3bec-41c5-827a-97771e941b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:45.333224 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38703ea-3bec-41c5-827a-97771e941b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:45.334434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38703ea-3bec-41c5-827a-97771e941b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:45.336909 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38703ea-3bec-41c5-827a-97771e941b06 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:45.353740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1426/2850] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:45.359281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:45.365716 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ef06-db2e-4497-98a2-5a0e295a7d16 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:45.370586 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:45.371507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:45.371785 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:45.372058 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] PATH_INFO: `/v3/projects/c9cf7969a63e46e9aeef5dc53410d51b/users/f45b823dc34b4c17818b1afec6c33d0b/roles/ee6f8f6890e94abb9ce1c10ac47520e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:45.398249 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cf7969a63e46e9aeef5dc53410d51b, user_id=f45b823dc34b4c17818b1afec6c33d0b, role_id=ee6f8f6890e94abb9ce1c10ac47520e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:45.401301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:45.561846 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1425/2851] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:28:45 2022] PUT /identity/v3/projects/c9cf7969a63e46e9aeef5dc53410d51b/users/f45b823dc34b4c17818b1afec6c33d0b/roles/ee6f8f6890e94abb9ce1c10ac47520e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:45.564027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774ee2-089a-4a48-9b3c-8dbca3367fd0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:45.564027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774ee2-089a-4a48-9b3c-8dbca3367fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:45.564027 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774ee2-089a-4a48-9b3c-8dbca3367fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:45.598707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-86774ee2-089a-4a48-9b3c-8dbca3367fd0 None None] MFA Rules not processed for user `173c08a245ff42c4826381dd87480484`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:45.598707 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-86774ee2-089a-4a48-9b3c-8dbca3367fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:45.688461 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1427/2852] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:45.699832 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:45.701698 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:45.777475 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc5a9-9397-4f1c-bb20-877dee74270f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:45.781974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:45.782573 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:45.782814 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:45.783125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:45.798677 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:45.800557 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:45.812904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1426/2853] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:28:48.814843 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fb37-8a11-4543-8c4b-f3d06cf78850 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:48.815376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fb37-8a11-4543-8c4b-f3d06cf78850 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:48.815376 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fb37-8a11-4543-8c4b-f3d06cf78850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:48.867305 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c353fb37-8a11-4543-8c4b-f3d06cf78850 None None] MFA Rules not processed for user `a9150eafa2cc41f5ac56105976d658a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:48.868642 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c353fb37-8a11-4543-8c4b-f3d06cf78850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:48.942849 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:48.979730 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1428/2854] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:48.984025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:48.985640 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:49.001127 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ccada-f8f1-45b5-8743-277f1a16331f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:49.006003 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:49.006668 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:49.006951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:49.007228 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:49.007936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:49.010068 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:49.026565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:49.201960 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1427/2855] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:28:48 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:28:49.206220 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fb37-8a11-4543-8c4b-f3d06cf78850 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:49.218424 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fb37-8a11-4543-8c4b-f3d06cf78850 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:49.281328 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:49.285540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:49.285540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:49.285540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:49.285540 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:49.286467 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:49.390172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1429/2856] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:28:49 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:49.395302 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:49.408598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50005651-a312-4399-a8a0-1da93264f637 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:49.415297 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:49.416036 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:49.416400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:49.416684 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:49.417417 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:49.419621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:49.438278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:49.439973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1428/2857] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:49.450444 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49509a-edde-45e3-965a-649d85150473 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:49.455463 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:49.457752 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:49.458260 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:49.458593 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] PATH_INFO: `/v3/projects/039826849f0f4f82a1207931ed5b03c1/users/ea5fffb7ae284ec6b11930fc528e041a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:49.477490 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=039826849f0f4f82a1207931ed5b03c1, user_id=ea5fffb7ae284ec6b11930fc528e041a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:49.480738 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:49.607560 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1430/2858] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:28:49 2022] PUT /identity/v3/projects/039826849f0f4f82a1207931ed5b03c1/users/ea5fffb7ae284ec6b11930fc528e041a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:49.614718 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:49.629005 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff56a-d39a-4124-8136-e307d63fb17e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:49.704015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9948a5-199b-4524-b218-260c7739cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:49.704732 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9948a5-199b-4524-b218-260c7739cb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:49.705020 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9948a5-199b-4524-b218-260c7739cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:49.705299 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9948a5-199b-4524-b218-260c7739cb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:49.706097 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9948a5-199b-4524-b218-260c7739cb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:49.708187 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9948a5-199b-4524-b218-260c7739cb0a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:49.719189 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1429/2859] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:49.723807 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:49.735267 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa813f-0085-4ea4-8d6c-dafc0206d32b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:49.740495 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:49.743396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:49.743396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:49.743396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] PATH_INFO: `/v3/projects/039826849f0f4f82a1207931ed5b03c1/users/ea5fffb7ae284ec6b11930fc528e041a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:49.744571 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039826849f0f4f82a1207931ed5b03c1, user_id=ea5fffb7ae284ec6b11930fc528e041a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:49.747311 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:49.818606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1431/2860] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:28:49 2022] PUT /identity/v3/projects/039826849f0f4f82a1207931ed5b03c1/users/ea5fffb7ae284ec6b11930fc528e041a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:53.717177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2fc4-17d5-41a7-96d9-30fe5b87a5f3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:53.717177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2fc4-17d5-41a7-96d9-30fe5b87a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:53.717177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2fc4-17d5-41a7-96d9-30fe5b87a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:53.752734 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d70c2fc4-17d5-41a7-96d9-30fe5b87a5f3 None None] MFA Rules not processed for user `f45b823dc34b4c17818b1afec6c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:53.762943 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d70c2fc4-17d5-41a7-96d9-30fe5b87a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:53.949155 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1430/2861] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:53.953956 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:54.048409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43f632-ba89-48fb-b2de-5b243edbc3a9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:54.055793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:54.056639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:54.056930 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:54.057207 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:54.059785 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:54.062380 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:54.203436 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1432/2862] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 08:28:53 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:54.206171 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2fc4-17d5-41a7-96d9-30fe5b87a5f3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:54.226700 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2fc4-17d5-41a7-96d9-30fe5b87a5f3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:54.311594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:54.319307 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:54.319609 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:54.319922 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:54.320757 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:54.322762 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:54.498727 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:54.508658 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1431/2863] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 08:28:54 2022] POST /identity/v3/users => generated 298 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:28:54.508850 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:54.529614 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4826-ea7a-4f7d-b9ed-391b572a8f78 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:54.612511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:54.616429 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:54.619629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:54.619629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:54.619629 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:54.624257 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:54.670367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1433/2864] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:28:54.674149 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:54.723632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d49d71-29ac-4f95-b08d-ae58c2048c7d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:54.742158 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:54.743517 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:54.744075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:54.744705 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] PATH_INFO: `/v3/projects/cc2f442a6e4d4fed9abeb17cab71a273/users/bd5c623bb5fd4233ba55c148087fcb5a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:54.798991 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2f442a6e4d4fed9abeb17cab71a273, user_id=bd5c623bb5fd4233ba55c148087fcb5a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:54.809128 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:54.949056 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1432/2865] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:28:54 2022] PUT /identity/v3/projects/cc2f442a6e4d4fed9abeb17cab71a273/users/bd5c623bb5fd4233ba55c148087fcb5a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:54.952423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:54.976310 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e63f1-d521-4db3-bec6-aa3a78ae7145 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:55.023269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:28:55.168481 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f3c83-f263-4f48-99b2-b67f2cec05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:55.171340 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f3c83-f263-4f48-99b2-b67f2cec05e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:55.171806 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f3c83-f263-4f48-99b2-b67f2cec05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:55.172919 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f3c83-f263-4f48-99b2-b67f2cec05e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:55.173858 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f3c83-f263-4f48-99b2-b67f2cec05e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:55.178039 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f3c83-f263-4f48-99b2-b67f2cec05e4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:55.194156 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1434/2866] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 08:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:28:55.197854 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:55.213008 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29d23-a07c-48ce-a853-81330c3577d3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:55.220904 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:55.222946 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:55.223952 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:55.224483 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] PATH_INFO: `/v3/projects/cc2f442a6e4d4fed9abeb17cab71a273/users/bd5c623bb5fd4233ba55c148087fcb5a/roles/278b998773bb4ec89978fcb835ceffc7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:55.226848 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2f442a6e4d4fed9abeb17cab71a273, user_id=bd5c623bb5fd4233ba55c148087fcb5a, role_id=278b998773bb4ec89978fcb835ceffc7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:55.230399 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:55.255356 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1433/2867] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 08:28:55 2022] PUT /identity/v3/projects/cc2f442a6e4d4fed9abeb17cab71a273/users/bd5c623bb5fd4233ba55c148087fcb5a/roles/278b998773bb4ec89978fcb835ceffc7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:28:59.272709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5d5af-9801-4328-a0ba-08d4c54b251a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:59.272709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5d5af-9801-4328-a0ba-08d4c54b251a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:59.272709 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5d5af-9801-4328-a0ba-08d4c54b251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:59.309127 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4fe5d5af-9801-4328-a0ba-08d4c54b251a None None] MFA Rules not processed for user `ea5fffb7ae284ec6b11930fc528e041a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:28:59.310597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4fe5d5af-9801-4328-a0ba-08d4c54b251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:59.412904 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1435/2868] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:28:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:28:59.422138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:28:59.424002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:28:59.620764 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e788d-48bd-42f2-a068-14639c2391a5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:28:59.631615 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c968059-848f-47f9-bfd9-c7cb3f50c5ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:28:59.632592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968059-848f-47f9-bfd9-c7cb3f50c5ec service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:28:59.633025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968059-848f-47f9-bfd9-c7cb3f50c5ec service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:28:59.638021 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968059-848f-47f9-bfd9-c7cb3f50c5ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:28:59.739945 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c968059-848f-47f9-bfd9-c7cb3f50c5ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:28:59.742396 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c968059-848f-47f9-bfd9-c7cb3f50c5ec service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:28:59.758858 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1434/2869] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:28:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:00.189926 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5d5af-9801-4328-a0ba-08d4c54b251a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:00.312539 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5d5af-9801-4328-a0ba-08d4c54b251a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:00.319513 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd21e6-a347-4eaa-8708-e46e2b96fb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:00.320704 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd21e6-a347-4eaa-8708-e46e2b96fb1f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:00.320886 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd21e6-a347-4eaa-8708-e46e2b96fb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:00.321344 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd21e6-a347-4eaa-8708-e46e2b96fb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:00.323866 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f7bd21e6-a347-4eaa-8708-e46e2b96fb1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:00.441769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:00.470102 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd21e6-a347-4eaa-8708-e46e2b96fb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:00.471654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd21e6-a347-4eaa-8708-e46e2b96fb1f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:00.490769 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1436/2870] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:03.642349 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:03.642912 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:03.643018 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:03.664529 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] MFA Rules not processed for user `a9150eafa2cc41f5ac56105976d658a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:03.666066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:03.675740 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1435/2871] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:29:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:29:04.731720 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96121b58-3397-4851-9383-5224308c77f7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:04.738188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96121b58-3397-4851-9383-5224308c77f7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:04.738188 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96121b58-3397-4851-9383-5224308c77f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:04.763741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-96121b58-3397-4851-9383-5224308c77f7 None None] MFA Rules not processed for user `bd5c623bb5fd4233ba55c148087fcb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:04.765252 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-96121b58-3397-4851-9383-5224308c77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:04.857835 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1437/2872] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:29:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:29:04.869298 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:04.870875 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:04.950874 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d09475-b821-4d2d-8b55-225749f647f1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:04.955878 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61999e7673a4a1cbc5ad487f8d16845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:04.957114 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:04.957406 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:04.957694 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:04.962486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:05.019935 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:05.021413 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:05.031442 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1436/2873] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:05.312456 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:05.312985 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:05.313423 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:05.341885 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:05.343211 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:05.430385 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1438/2874] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:29:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:29:05.446865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:05.448628 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:05.523890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d74eb-2c3b-4137-b9d1-9d9116f8795e service glance] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:05.529502 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:05.530251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:05.530589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:05.530869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:05.541202 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:05.542861 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:05.552917 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1437/2875] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:29:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:29:12.799042 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:12.800917 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:12.831795 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdaf24-28e6-49c0-9ce7-f7bfe51d9237 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:12.844030 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:12.845297 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:12.845793 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:12.846275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] PATH_INFO: `/v3/users/01fe8c57517d4ca5958ec13139aa2b74` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:12.848606 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fe8c57517d4ca5958ec13139aa2b74)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:12.854369 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:13.035679 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fe8c57517d4ca5958ec13139aa2b74'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.044034 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fe8c57517d4ca5958ec13139aa2b74'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.044946 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fe8c57517d4ca5958ec13139aa2b74'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.045625 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fe8c57517d4ca5958ec13139aa2b74'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.070477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:13.071712 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fe8c57517d4ca5958ec13139aa2b74'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.151200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1439/2876] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:29:12 2022] DELETE /identity/v3/users/01fe8c57517d4ca5958ec13139aa2b74 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:13.499270 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:13.526865 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44948-22d5-4797-a1b5-ff1a33cde675 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:13.613284 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:13.614411 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:13.614776 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:13.615221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] PATH_INFO: `/v3/projects/9170777eb80e46bd9d8ea3a576a9678c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:13.616653 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9170777eb80e46bd9d8ea3a576a9678c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:13.618928 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:13.878913 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:13.888565 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9170777eb80e46bd9d8ea3a576a9678c', 'request_id': 'req-b8b45108-c2fe-4aca-afb0-fafb264dbf96'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.895030 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9170777eb80e46bd9d8ea3a576a9678c', 'request_id': 'req-b8b45108-c2fe-4aca-afb0-fafb264dbf96'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.980070 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9170777eb80e46bd9d8ea3a576a9678c', 'request_id': 'req-b8b45108-c2fe-4aca-afb0-fafb264dbf96'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.992609 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] The token cache is being invalidate because project 9170777eb80e46bd9d8ea3a576a9678c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:29:13.992948 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.993596 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:13.995567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1438/2877] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:29:13 2022] DELETE /identity/v3/projects/9170777eb80e46bd9d8ea3a576a9678c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:13.999652 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:14.002772 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:14.019950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7369a84-4ce9-4ce6-8384-cc679508dc12 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:14.102409 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:14.103455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:14.103740 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:14.104018 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] PATH_INFO: `/v3/users/e6736929ec2f4da3aecb614d6048794d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:14.105394 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6736929ec2f4da3aecb614d6048794d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:14.107366 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:14.317789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6736929ec2f4da3aecb614d6048794d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:14.348744 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6736929ec2f4da3aecb614d6048794d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:14.349505 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6736929ec2f4da3aecb614d6048794d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:14.352113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6736929ec2f4da3aecb614d6048794d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:14.370499 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fe8a3c1-088a-478f-b413-8513a09b69ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6736929ec2f4da3aecb614d6048794d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:14.476043 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1440/2878] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:29:13 2022] DELETE /identity/v3/users/e6736929ec2f4da3aecb614d6048794d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:14.790482 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:14.792758 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:14.850632 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b45108-c2fe-4aca-afb0-fafb264dbf96 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:14.923471 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:14.924672 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:14.925468 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:14.926125 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] PATH_INFO: `/v3/projects/de525ebdfc9346a69d911aa830b98049` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:14.926998 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de525ebdfc9346a69d911aa830b98049)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:14.928970 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:15.058312 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de525ebdfc9346a69d911aa830b98049', 'request_id': 'req-d2a14236-8cd4-42d6-96bd-d431efd6712d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:15.066657 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de525ebdfc9346a69d911aa830b98049', 'request_id': 'req-d2a14236-8cd4-42d6-96bd-d431efd6712d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:15.173156 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de525ebdfc9346a69d911aa830b98049', 'request_id': 'req-d2a14236-8cd4-42d6-96bd-d431efd6712d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:15.188621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] The token cache is being invalidate because project de525ebdfc9346a69d911aa830b98049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:29:15.189013 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:15.189768 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:29:15.192014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1439/2879] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:29:14 2022] DELETE /identity/v3/projects/de525ebdfc9346a69d911aa830b98049 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:17.828125 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:17.828724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:17.828724 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:17.846200 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] MFA Rules not processed for user `f45b823dc34b4c17818b1afec6c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:17.847980 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:17.904585 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1441/2880] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 08:29:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:29:18.161715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:18.163123 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:18.220688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14236-8cd4-42d6-96bd-d431efd6712d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:18.225059 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:18.225691 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:18.225971 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:18.226244 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:18.228014 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:18.238251 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:18.239742 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:18.242967 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:18.248384 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1440/2881] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:18.660918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:18.662918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:18.678841 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:18.738095 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692800f-83f3-451a-997c-c3b08c3572eb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:18.742976 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeadeca-eda6-4aa0-ad46-525975f9c7aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:18.743619 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeadeca-eda6-4aa0-ad46-525975f9c7aa service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:18.743899 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeadeca-eda6-4aa0-ad46-525975f9c7aa service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:18.744172 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeadeca-eda6-4aa0-ad46-525975f9c7aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:18.745951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cbeadeca-eda6-4aa0-ad46-525975f9c7aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:18.757716 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeadeca-eda6-4aa0-ad46-525975f9c7aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:18.759283 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeadeca-eda6-4aa0-ad46-525975f9c7aa service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:18.770453 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1442/2882] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:21.168514 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:21.178256 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9f98-654a-496f-b507-e46872146f1b service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:21.182199 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:21.182834 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:21.183118 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:21.183400 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:21.185215 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:21.195611 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:21.197445 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:21.206093 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1441/2883] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:21.379888 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:21.380823 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:21.381219 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:21.399753 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:21.401084 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:21.462995 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1443/2884] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 08:29:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:29:21.476434 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:21.478422 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:21.558688 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc752-573d-4dd4-ba0f-3cdf73db17b9 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:21.564254 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:21.564936 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:21.565220 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:21.565500 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:21.576941 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:21.578567 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:21.587025 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1442/2885] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:29:30.247029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:30.248466 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:30.261166 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfab64f-7296-486b-8546-25865e191bb2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:30.264943 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:30.265615 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:30.265898 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:30.266174 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:30.267975 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:30.281342 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:30.282722 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:30.291686 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1444/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:31.074205 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:31.075803 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:31.162864 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a7315-aaa0-42e1-9318-ade994136d4a service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:31.169098 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:31.169761 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:31.170048 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:31.170335 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:31.172277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:31.187317 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:31.188980 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:31.202293 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1443/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:37.554006 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:37.567728 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4df0f4-af9c-4c58-a9eb-5eb8d30994bf service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:37.573265 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:37.573906 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:37.574190 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:37.574468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:37.576324 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:37.588749 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:37.590355 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:37.601110 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1445/2888] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:41.198012 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=73 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:47.596375 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=63 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:48.656516 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:48.666512 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc5dfe-7daf-467f-b73d-8e94a31c5740 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:48.670089 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:48.670713 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:48.670992 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:48.671266 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:48.673028 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:48.737075 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:48.738494 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:48.748648 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1444/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:29:50.923455 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.924937 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:50.940529 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ec6ef-55ff-445f-9ac2-6e0f923e076e service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.948576 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55c19e-661a-4ad3-b75b-a2d5b0619e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7602c632829d44179aa129c552d1870a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.949234 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55c19e-661a-4ad3-b75b-a2d5b0619e2f service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.949526 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55c19e-661a-4ad3-b75b-a2d5b0619e2f service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.949805 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55c19e-661a-4ad3-b75b-a2d5b0619e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.951601 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9b55c19e-661a-4ad3-b75b-a2d5b0619e2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:50.965275 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55c19e-661a-4ad3-b75b-a2d5b0619e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.967032 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55c19e-661a-4ad3-b75b-a2d5b0619e2f service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.982950 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1446/2890] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:29:50.996143 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:51.005142 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70727-e5c8-4965-90b1-8bcda7dc2b58 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:51.009906 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:51.010566 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:51.010850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:51.011258 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:51.013204 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:51.082066 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:51.083525 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:51.094994 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1445/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:30:00.978627 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:01.089835 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=60 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.980586 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.981359 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.981543 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.020033 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] MFA Rules not processed for user `650f8582a9ce4fc29f1a31e01dd74cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:24.021270 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:24.055107 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1447/2892] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:31:24.093695 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.136277 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7116e5-a65b-49da-8755-a993414288a1 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.141301 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277ec365bac4e9d8a22f63c55bbb908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.141939 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.142221 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.142498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.150715 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.152387 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.160974 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1446/2893] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 08:31:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:31:28.247426 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.249113 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:28.294597 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a53f13-e284-4167-a4c8-7f74472c7865 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.299637 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.301295 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.301440 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.301778 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.303948 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:28.317437 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.319269 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.333693 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1448/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:31:28.510589 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.522255 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31e6b-bcb8-47c9-8eca-57cd43e09684 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.527479 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.528112 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.528446 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.528721 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.530490 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:28.542852 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.544452 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.555281 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1447/2895] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:31:32.641048 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.642477 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:32.740038 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9124fd-e5e7-4807-a1c1-5bee1a938fb3 service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.744789 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.745667 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.745951 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.746230 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] PATH_INFO: `/v3/users/f45b823dc34b4c17818b1afec6c33d0b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.747415 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45b823dc34b4c17818b1afec6c33d0b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:32.749383 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:32.875104 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45b823dc34b4c17818b1afec6c33d0b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:32.877121 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:32.883279 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45b823dc34b4c17818b1afec6c33d0b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:32.883890 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45b823dc34b4c17818b1afec6c33d0b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:32.884511 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45b823dc34b4c17818b1afec6c33d0b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:32.896474 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45b823dc34b4c17818b1afec6c33d0b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:32.952161 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1449/2896] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:31:32 2022] DELETE /identity/v3/users/f45b823dc34b4c17818b1afec6c33d0b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:33.200024 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.212306 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca8ab5-9e67-4ec3-ada1-c04cf89fe097 service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.270568 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.271443 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.271725 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.272000 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] PATH_INFO: `/v3/projects/c9cf7969a63e46e9aeef5dc53410d51b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.273210 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cf7969a63e46e9aeef5dc53410d51b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.275145 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.382599 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cf7969a63e46e9aeef5dc53410d51b', 'request_id': 'req-5d843e89-bd90-4acb-86df-40af0dd2e5f8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.388797 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cf7969a63e46e9aeef5dc53410d51b', 'request_id': 'req-5d843e89-bd90-4acb-86df-40af0dd2e5f8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.444449 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cf7969a63e46e9aeef5dc53410d51b', 'request_id': 'req-5d843e89-bd90-4acb-86df-40af0dd2e5f8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.456813 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] The token cache is being invalidate because project c9cf7969a63e46e9aeef5dc53410d51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:31:33.457108 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.457807 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.459390 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1448/2897] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:31:33 2022] DELETE /identity/v3/projects/c9cf7969a63e46e9aeef5dc53410d51b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:31:33.463504 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.464918 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:33.478367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f9e26-084e-4e5d-a316-1b7753954c1c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.533327 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.534399 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.535191 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.535485 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] PATH_INFO: `/v3/users/bd5c623bb5fd4233ba55c148087fcb5a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.536694 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5c623bb5fd4233ba55c148087fcb5a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.538681 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.680775 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5c623bb5fd4233ba55c148087fcb5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.687497 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5c623bb5fd4233ba55c148087fcb5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.688158 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5c623bb5fd4233ba55c148087fcb5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.689103 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5c623bb5fd4233ba55c148087fcb5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.701915 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5c623bb5fd4233ba55c148087fcb5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:33.764367 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1450/2898] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:31:33 2022] DELETE /identity/v3/users/bd5c623bb5fd4233ba55c148087fcb5a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:34.017435 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:34.019840 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:34.032656 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d843e89-bd90-4acb-86df-40af0dd2e5f8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:34.065042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:34.091081 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:34.091932 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:34.092230 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:34.092507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] PATH_INFO: `/v3/projects/cc2f442a6e4d4fed9abeb17cab71a273` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:34.093665 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2f442a6e4d4fed9abeb17cab71a273)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:34.095593 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:34.210262 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2f442a6e4d4fed9abeb17cab71a273', 'request_id': 'req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:34.215754 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2f442a6e4d4fed9abeb17cab71a273', 'request_id': 'req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:34.284347 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2f442a6e4d4fed9abeb17cab71a273', 'request_id': 'req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:34.295385 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] The token cache is being invalidate because project cc2f442a6e4d4fed9abeb17cab71a273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:31:34.295670 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:34.296419 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:31:34.298043 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1449/2899] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:31:34 2022] DELETE /identity/v3/projects/cc2f442a6e4d4fed9abeb17cab71a273 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:43.760639 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=64,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:44.292498 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:03.649742 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:03.651289 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:03.740797 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefb5dd-8e47-4938-9098-1482c44764f2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:03.791274 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:03.791840 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:03.792126 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:03.792434 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:03.794250 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:03.803654 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:03.805199 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:03.813294 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1451/2900] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:32:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:32:03.892486 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:03.894042 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:03.907084 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467697e-348d-4cc6-9bfa-5bf82ba9afa6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:03.910693 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:03.911389 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:03.911759 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:03.912041 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:03.913923 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:03.998984 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:04.000458 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:04.022002 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1450/2901] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:32:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:32:13.809592 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=55 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:14.019243 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=43 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:41.615988 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:41.627210 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015556c4-6f99-4bdb-a927-9c3579203ce0 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:41.629202 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:41.629834 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:41.630117 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:41.630388 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:41.632277 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:41.646872 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:41.650181 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:41.660508 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1452/2902] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:33:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:33:44.210790 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:44.212322 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:44.223581 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b248119-e6db-49eb-9c62-a25019847382 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:44.227644 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8183015eed4fd19e4a5fdf57d341e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:44.228313 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:44.228594 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:44.228869 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:44.230598 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:44.298951 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:44.300473 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:44.310507 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1451/2903] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:33:47.627179 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:47.628759 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:47.700645 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d1bd-17ba-437d-842b-557cc2a4e424 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:47.706012 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:47.708471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:47.708471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:47.708471 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:47.709258 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:47.720550 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:47.722133 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:47.734553 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1453/2904] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:33:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:33:51.287216 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:51.288739 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:51.301454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adccf32-e49c-4297-9d1e-bc08642e38db service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:51.307233 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:51.308177 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:51.308492 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:51.308815 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] PATH_INFO: `/v3/users/a9150eafa2cc41f5ac56105976d658a2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:51.310015 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9150eafa2cc41f5ac56105976d658a2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:51.311931 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:51.481574 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9150eafa2cc41f5ac56105976d658a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:51.493836 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9150eafa2cc41f5ac56105976d658a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:51.502138 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9150eafa2cc41f5ac56105976d658a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:51.502956 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9150eafa2cc41f5ac56105976d658a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:51.568602 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9150eafa2cc41f5ac56105976d658a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:51.575856 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1452/2905] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:33:51 2022] DELETE /identity/v3/users/a9150eafa2cc41f5ac56105976d658a2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:33:51.826326 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:51.837739 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953068-6230-413d-8581-8ef5190105f5 service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:51.897433 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:51.898278 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:51.898587 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:51.898861 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] PATH_INFO: `/v3/projects/bdb93f2721d548d7b01475fb650d882f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:51.900029 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb93f2721d548d7b01475fb650d882f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:51.901970 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:52.004882 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb93f2721d548d7b01475fb650d882f', 'request_id': 'req-8aa1cd18-164e-4040-ad86-63b92cff301e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.072549 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb93f2721d548d7b01475fb650d882f', 'request_id': 'req-8aa1cd18-164e-4040-ad86-63b92cff301e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.078891 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb93f2721d548d7b01475fb650d882f', 'request_id': 'req-8aa1cd18-164e-4040-ad86-63b92cff301e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.089396 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] The token cache is being invalidate because project bdb93f2721d548d7b01475fb650d882f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:33:52.089676 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.090300 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.091968 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1454/2906] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:33:51 2022] DELETE /identity/v3/projects/bdb93f2721d548d7b01475fb650d882f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:33:52.096061 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:52.097467 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:52.110697 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6ea6-6eb7-421f-a1a5-c0155bd6b053 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:52.167182 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:52.168046 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:52.168355 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:52.168626 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] PATH_INFO: `/v3/users/ea5fffb7ae284ec6b11930fc528e041a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:52.169801 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5fffb7ae284ec6b11930fc528e041a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:52.171709 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:52.176880 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:52.375855 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5fffb7ae284ec6b11930fc528e041a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.388890 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5fffb7ae284ec6b11930fc528e041a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.395621 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5fffb7ae284ec6b11930fc528e041a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.397252 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5fffb7ae284ec6b11930fc528e041a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.461426 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5fffb7ae284ec6b11930fc528e041a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:52.467850 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1453/2907] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 08:33:52 2022] DELETE /identity/v3/users/ea5fffb7ae284ec6b11930fc528e041a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:33:52.735142 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:52.736675 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:52.753741 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1cd18-164e-4040-ad86-63b92cff301e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:52.759671 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:52.817244 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173c08a245ff42c4826381dd87480484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed29b44386f4c7ba3757cfe7b05f1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:52.818969 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:52.819195 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:52.819468 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] PATH_INFO: `/v3/projects/039826849f0f4f82a1207931ed5b03c1` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:52.820702 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=039826849f0f4f82a1207931ed5b03c1)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:52.822673 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:52.941122 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039826849f0f4f82a1207931ed5b03c1', 'request_id': 'req-a899b585-2c76-426e-b8d2-7c160ccaa4be'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:53.024768 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039826849f0f4f82a1207931ed5b03c1', 'request_id': 'req-a899b585-2c76-426e-b8d2-7c160ccaa4be'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:53.031557 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039826849f0f4f82a1207931ed5b03c1', 'request_id': 'req-a899b585-2c76-426e-b8d2-7c160ccaa4be'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:53.041887 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] The token cache is being invalidate because project 039826849f0f4f82a1207931ed5b03c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:33:53.042175 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:53.042804 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a899b585-2c76-426e-b8d2-7c160ccaa4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:33:53.044374 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1455/2908] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 08:33:52 2022] DELETE /identity/v3/projects/039826849f0f4f82a1207931ed5b03c1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:34:02.464050 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:03.038855 dv-cinder-834822-6-iscsi devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:32.191364 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:32.192817 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:32.262795 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd338fc-afc4-46b3-ad6f-80067a940f05 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:32.321454 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd701-e11b-4e60-a66e-67a749a370e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a535c818476847f5bfe081a66a239331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94006e699c6649098c687eb8363c07e2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:32.322092 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd701-e11b-4e60-a66e-67a749a370e2 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:32.322375 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd701-e11b-4e60-a66e-67a749a370e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:32.322651 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd701-e11b-4e60-a66e-67a749a370e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:32.324457 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60edd701-e11b-4e60-a66e-67a749a370e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:32.335973 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edd701-e11b-4e60-a66e-67a749a370e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:32.337592 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edd701-e11b-4e60-a66e-67a749a370e2 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:32.347418 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1454/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:42.343135 dv-cinder-834822-6-iscsi devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=58 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}